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(54) Automatic rearview mirror and vehicle interior monitoring system using a photosensor array 



(57) A compartment image data storage system for 
an automotive vehicle. Photosensor array means (32) 
are provided for sensing light levels in at least a portion 
of a vehicle compartment and generating photosensor 
array signals. Furthermore, determining means (46) 
coupled to the photosensor array means (32) are pro- 
vided for receiving the photosensor array signals and 



determining a set of values indicative of at least a por- 
tion of the photosensor array signals. Memory means 
(57) coupled to the determining means (46) receive and 
store the values indicative of the photosensor array sig- 
nals. 
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Description 

This application is a continuation-in-part of co-pending U.S. Patent Application Ser. No. 08/023,918, filed Feb. 26, 
1993 

5 

BACKGROUND OF THE INVENTION 
Field of the Invention 

10 This invention relates to an automatic rearview mirror system for automotive vehicles which automatically changes 
reflectance level in response to glare causing light, and more particularly relates to an improved automatic rearview mir- 
ror system using only a rearwardly facing sensor. This invention further relates to an automatic rearview mirror and vehi- 
cle interior monitoring system for automotive vehicles which also monitors a vehicle interior or compartment. This 
invention further relates to an automatic rearview mirror and vehicle interior monitoring system for automotive vehicles 

15 which may also be used as a vehicle intrusion detection system or as a compartment image data storage system. 

Description of Related Art 

Automatic rearview mirrors and mirror systems have been devised for varying the reflectance level of a variable 
20 reflectance rearview mirror by reducing the reflectance automatically in response to annoying glare light, as seen rear- 
wardly of the rearview mirror or mirrors by a driver of the vehicle, and by increasing automatically the reflectance to a 
normal or maximum reflectance level when the annoying glare light subsides. These automatic mirrors have been 
changed over the years in an effort to improve their performance characteristics and associated level of glare protec- 
tion. 

25 Early automatic rearview mirrors used a rearwardly facing sensor and control circuit to change mirror reflectance. 
One example of such a "single-sensor" type mirror is described in U.S. Patent No. 4,266,856. In these prior art single- 
sensor type mirrors, the rear glare light was incident on a rearwardly facing sensor or photocell, such as a photodiode, 
photoresistor or phototransistor. These mirrors suffered from various problems, however, including the problem that 
these mirrors would become increasingly sensitive and even "lock-up" in their minimum reflectance level or state as the 

30 driver encountered significantly higher light levels in town or city driving. This required the driver to repeatedly adjust 
the mirror's sensitivity control to prevent such problems. 

To overcome the problems of single-sensor type mirrors, a non-rearwardly facing photocell for sensing "ambient" 
light was added. It was believed that the desired reflectance necessary to relieve the driver from glare depended not 
only on glare light but also on ambient light. Accordingly, these "two-sensor" type mirrors used two separate photocells, 

35 one generally facing rearwardly and one generally facing forwardly (or other non-rearwardly facing direction) of the mir- 
ror or vehicle. The signals from these two photocells were then compared in some fashion, and when, for example, the 
glare light from the rear was comparatively high with respect to the "ambient" light, a control circuit would apply a control 
signal to reduce mirror reflectance. Some examples are described in German Laid-Open Patent No. 3,041,612; Japa- 
nese Laid-Open Patent No. 58-19941 ; and U.S. Patents Nos. 3,601 ,614; 3,612,666; 3,680,951 ; 3,746,430; 4,443,057; 

40 4,580,875; 4,690,508; and 4,917,477. In many of these prior art automatic rearview mirrors, light generally forward of 
the mirror or vehicle was incident on the second photocell. 

These arrangements, however, also had problems. In some of these mirrors the forwardly facing or "ambient" light 
sensor was inaccurate because it did not correctly measure ambient light levels since it did not include light generally 
rearward of the mirror or vehicle. Some examples include the devices described in U.S. Patent Nos. 4,443,057 and 

45 4,91 7,477. Other prior art devices overcame these deficiencies by providing a control circuit which correctly measured 
ambient light as a combination of both the forward and rear light levels. Examples of this significantly different approach 
are described in U.S. Patent Nos. 4,793,690 and 4,886,960. 

The prior art two-sensor type systems generally provided improved performance over prior art single-sensor type 
systems but were also more complex and costly. In part, this was because using separate forwardly and rearwardly fac- 

so ing photocells required that the performance characteristics of the two separate photocells, such as photoresistors, be 
matched appropriately to ensure consistent performance under various operating conditions. Matching photocells such 
as photoresistors, however, generally involves complex, expensive and time consuming operations and procedures. 

Both the prior art single-sensor and two-sensor type mirrors presented additional problems when they were also 
used to control the exterior side view mirrors. This is because such prior art systems used a common control or drive 

55 signal to change the reflectance level of both the interior rearview mirror and the exterior left and/or right side view mir- 
rors by substantially the same amount. In U.S. Patent No. 4,669,826. for example, a single-sensor type mirror system 
used two rearwardly facing photodiodes to control both an interior rearview mirror and the left and/or right side view mir- 
rors based on the direction of incident light from the rear. Another example includes the two-sensor type system 
described in U.S. Patent No. 4,917,477. 
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In rearview mirror systems, however, each of the interior rearview and exterior side view mirrors may reflect differ- 
ent source light levels. More specifically, the inside rearview mirror, left side view mirror and right side view mirror each 
enable the driver to view a different portion or zone of the total rearward area. Of course, there may be some overlap of 
the image information contained in each of the three zones. The situation is further complicated with multi-lane traffic 

5 because each of the mirrors reflects different light levels caused by the headlights of the vehicles which are following, 
passing or being passed. As a result, in the prior art systems, when the reflectance level of the interior rearview mirror 
was reduced to decrease the glare of headlights reflected therein, the reflectance level of the exterior left and right side 
view mirrors was also reduced by substantially the same amount, even though, for example, the side view mirrors might 
not be reflecting the same level of glare light, if any. Accordingly, rear vision in the exterior left and right side view mirrors 

10 could be improperly reduced. 

Other prior art two-sensor type systems used a common ambient light sensor and several rearwardly facing sen- 
sors, one for each of the mirrors. An example is the alternate system also described in U.S. Patent No. 4,91 7,477. This 
approach is not satisfactory, however, because it reduces system reliability and increases complexity and cost. 

Finally, some prior anti-glare mirrors used several sensors to control the segments of a variable reflectance mirror. 

is One example is disclosed in U.S. Patent No. 4,632,509, which discloses a single-sensor type mirror using three rear- 
wardly facing photocells to control three mirror segments depending on the direction of incident light from the rear. See 
also U.S. Patent No. 4,697,883. These prior mirror systems generally have the same problems as the other single-sen- 
sor type mirrors. Some other anti-glare mirrors are generally disclosed in U.S. Patent Nos. 3,986,022; 4,614,415; and 
4,672,457. 

20 Consequently, there is a need for an automatic rearview mirror system for an automotive vehicle having improved 
reliability and low cost, which accurately determines or otherwise discriminates light levels that the driver will experience 
as glare without the need for a separate fbrwardly facing photocell. In addition, as noted above, there is also a need for 
an automatic rearview mirror system of high reliability and low cost, which accurately determines light levels that the 
driver will experience as glare, and which can control independently the reflectance of a plurality of mirrors according 

25 to the light levels actually reflected by each of the rearview and exterior side view mirrors without the need for additional 
and separate rearwardly facing photocells. There is also a need for an automatic rearview mirror system that can inde- 
pendently control the segments of a variable reflectance mirror while accurately determining light levels that the driver 
will experience as glare in each segment of the mirror without the need for additional and separate fbrwardly and rear- 
wardly facing photocells. 

30 Unauthorized vehicle intrusion for the purpose of stealing the vehicle or its contents is a significant problem. Each 
year, automotive manufacturers are including vehicle anti-theft or intrusion detection systems on more vehicles to deter 
potential intruders and to prevent the theft of vehicles or their contents. Currently known vehicle anti-theft systems are 
generally designed to protect the vehicle or its contents from theft or vandalism. There are many versions of vehicle 
anti-theft systems using various sensor technologies that attempt to deter theft or vandalism using the horn, siren or 

35 flashing lights, or other alarm mechanisms to bring attention to a vehicle. As is known, existing intrusion detection sys- 
tems for vehicles use sensor technologies that have various limitations, including the problem of false triggering. For 
example, in many cases active vehicle alarms are simply ignored by people who assume that the alarm was falsely trig- 
gered. The proliferation of separate automatic rearview mirror systems and vehicle intrusion detection systems is also 
costly. Therefore, vehicle intrusion detection systems using an improved sensor technology are required that operate in 

40 combination with other vehicle systems (such as automatic rearview mirror systems) or that operate independently. 

Even with such anti-theft systems, recovered stolen vehicles typically provide little or no evidence of the vehicle 
thief. Therefore, systems are required that provide an image of the vehicle thief that would be useful to law enforcement 
and the insurance industry as an aid in identifying the person(s) responsible for the vehicle theft, and that operate in 
combination with other vehicle systems (such as automotive rearview mirror systems) or that operate independently. 

45 

SUMMARY QF THE INVENTION 

It is an object of the present invention to overcome the problems of the prior art. 

It is another object of the present invention to provide an automatic rearview mirror system of improved reliability. 
so It is yet another object of the present invention to provide an automatic rearview mirror system that accurately 
determines light levels that the driver will experience as glare without the need for a separate forward facing sensor or 
other non-rearwardly facing photocells. 

It is another object of the present invention to provide an automatic rearview mirror system of high reliability that 
accurately determines light levels that the driver will experience as glare, and which can independently control a plural- 
55 ity of mirrors or mirror segments according to different fields of view without the need for additional and separate rear- 
wardly facing photocells. 

According to one aspect of the present invention, using a photosensor array and an appropriate control circuit 
allows the elimination of separate forwardly facing or other non-rearwardly facing photocells, thereby allowing for lower 
costs and increased reliability since it is not necessary to match two separate photocells such as photoresistors. 
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According to another aspect, the present invention which achieves one or more of these objectives relates to a con- 
trol system for controlling a plurality of variable reflectance mirrors or mirror segments which change their reflectance 
in response to a signal from a drive circuit. The system comprises a plurality of variable reflectance mirrors, a photo- 
sensor array and a control circuit receiving signals from the photosensor array for controlling the mirrors. The photosen- 

5 sor array is mountable to view rearwardly of the mirror or vehicle. The photosensor array comprises a plurality of sets 
of photosensor elements corresponding to the plurality of variable reflectance mirrors. The photosensor elements in 
each set produce a plurality of photosensor element signals in response to light incident thereon. The control circuit 
determines control signals, indicative of a desired reflectance for each of the plurality of variable reflectance mirrors, in 
response to receiving photosensor element signals from the photosensor element set for each view or zone corre- 

w sponding to the rearview mirror and exterior side view mirrors and also (or alternatively) the mirror segments. The con- 
trol signals control the drive circuit to cause the plurality of variable reflectance mirrors or mirror segments to assume 
the desired reflectance. 

According to another aspect, the present invention which achieves one or more of these objectives relates to an 
automatic rearview mirror system for an automotive vehicle comprising at least one variable reflectance rearview mirror, 

15 and an array of sensing elements to sense light levels in an area rearward of the at least one variable reflectance rear- 
view mirror. Each of the sensing elements is adapted to sense light levels of light incident thereon and to output an elec- 
trical signal indicative of the sensed light levels. The system further comprises a signal processor, connected to the 
array of sensing elements, receiving and using the electrical signals indicative of the sensed light levels from the sens- 
ing elements to determine a first electrical signal indicative of a background light level in the area rearward of the at least 

20 one variable reflectance rearview mirror and to determine a second electrical signal indicative of at least one peak light 
level in the area rearward of the at least one variable reflectance rearview mirror. The signal processor determines at 
least one control signal indicative of the desired reflectance level of the at least one variable reflectance rearview mirror 
from the first electrical signal indicative of the background light level and the second electrical signal indicative of the at 
least one peak light level. The system further comprises at least one drive circuit connected to the signal processor and 

25 to the at least one variable reflectance rearview mirror for receiving the at least one control signal and generating and 
applying at least one drive signal to the at least one variable reflectance rearview mirror to drive the at least one variable 
reflectance mirror to the desired reflectance level. 

According to another aspect, the present invention which achieves one or more of these objectives relates to a con- 
trol system for controlling a plurality of variable reflectance mirrors, each of which change their reflectance level in 

30 response to a drive signal from an associated drive circuit, for an automotive vehicle. The system comprises a plurality 
of variable reflectance mirrors, and a photosensor array mountable to face substantially towards a rear area. The pho- 
tosensor array comprises a plurality of photosensor element sets. Each set comprises a plurality of photosensor ele- 
ments. Each of the photosensor elements generates a photosensor element signal indicative of a light level of light 
incident thereon, and each of the sets corresponds to one of the plurality of variable reflectance mirrors. The system 

35 further comprises a control circuit, connected to the photosensor array, for determining and applying a plurality of con- 
trol signals. Each of the control signals is indicative of a desired reflectance level for each of the plurality of variable 
reflectance mirrors in response to receiving the photosensor element signals from each of the plurality of photosensor 
element sets. The system further comprises a plurality of drive circuits connected to the control circuit and to different 
ones of the plurality of variable reflectance mirrors associated therewith. Each of the control signals is output to the drive 

40 circuit associated therewith, to generate and apply a drive signal to each of the plurality of variable reflectance mirrors 
causing each of the mirrors to assume a desired reflectance level. 

According to another aspect, the present invention which achieves one or more of these objectives relates to a con- 
trol system for controlling at least one variable reflectance mirror for an automotive vehicle. The system comprises pho- 
tosensor array means for sensing light levels in an area rearward of the at least one variable reflectance mirror and 

45 generating photosensor array signals, means for determining a background light signal from the photosensor array sig- 
nals, means for determining a peak light signal from the photosensor array signals, and means for controlling a reflect- 
ance level of the at least one variable reflectance mirror using the background and peak light signals. 

According to another aspect, the present invention which achieves one or more of these objectives relates to a 
method of controlling the reflectance of at least one variable reflectance mirror comprising the steps of sensing light lev- 

50 els in an area rearward of the at least one variable reflectance mirror with an array of sensing elements, determining a 
background light level from the sensed light levels, determining a peak light level from the sensed light levels, and con- 
trolling a reflectance level of the at least one variable reflectance mirror using the determined background and peak fight 
levels. 

By using a plurality of photosensor element sets or sub-arrays on a photosensor array to control a plurality of mir- 
55 rors and also (or alternatively) mirror segments, the mirrors may be controlled independently to vary their reflectance in 
accordance with the view associated with each of the photosensor element sets or sub-arrays. 

According to another aspect, the present invention relates to a control system for monitoring a vehicle interior and 
for controlling at least one variable reflectance mirror for an automotive vehicle. The system comprises photosensor 
array means for sensing light levels in an area rearward of said photosensor array means and generating at least a first 
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set of photosensor array signals, first determining means coupled to said photosensor array means for receiving said 
at least a first set of photosensor array signals and determining from at least a portion of said at least a first set of pho- 
tosensor array signals a first signal for controlling said at least one variable reflectance mirror, second determining 
means coupled to said photosensor array means for receiving said at least a first set of photosensor array signals and 

5 determining at least a first set of values indicative of said at least a portion of said at least a first set of photosensor array 
signals, and memory means coupled to said second determining means for receiving and storing said at least a portion 
of said at least a first set of photosensor array signals. 

According to another aspect, the present invention relates to a vehicle intrusion detection system for detecting 
movement within a vehicle interior for an automotive vehicle. The system comprises photosensor array means for sens- 

10 ing light levels in an area including at least a portion of a vehicle interior and generating at least a first set and a second 
set of photosensor array signals, determining means coupled to said photosensor array means for receiving said at 
least a first set and a second set of photosensor array signals and determining at least a first set and a second set of 
values indicative of said at least a first set and a second set of photosensor array signals, and comparing means cou- 
pled to said determining means for receiving said at least a first set and a second set of values indicative of said at least 

15 a first set and a second set of photosensor array signals and comparing said at least a first set and a second set of val- 
ues to generate at least one output control signal indicative of the correlation between said at least a first set and a sec- 
ond set of values. 

According to another aspect, the present invention relates to a compartment image data storage system for an 
automotive vehicle. The system comprises photosensor array means for sensing light levels in at least a portion of a 
20 vehicle compartment and generating at least a first set of photosensor array signals, determining means coupled to said 
photosensor array means for receiving said at least a first set of photosensor array signals and determining at least a 
first set of values indicative of said at least a first set of photosensor array signals, and memory means coupled to said 
determining means for receiving and storing said at least a first set of values indicative of said at least a first set of pho- 
tosensor array signals. 

25 These and other objects, advantages and features of the present invention will be readily understood and appreci- 
ated with reference to the detailed description of preferred embodiments discussed below together with the accompa- 
nying drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 

30 

Figure 1 A is a drawing of an automatic rearview mirror of the present invention, including an expanded view of a 
rearwardly facing photosensor array located in the upper center area of the mirror surface; 

Figure 1 B is another drawing of an automatic rearview mirror of the present invention, including an expanded view 
35 of the rearwardly facing photosensor array alternatively located in a bezel or chin of the mirror; 

Figure 2 is a drawing of an automotive vehicle with the automatic rearview mirror system of the present invention; 

Figure 2A is an illustrative diagram of a rearward area of a vehicle interior as viewed by the photosensor elements 
40 of the photosensor array for monitoring the vehicle interior; 

Figures 3A and 3B are illustrative diagrams of a rearward area as viewed by the photosensor elements of the pho- 
tosensor array; 

45 Figure 4A is a generalized diagram of a photosensor array PA(N,M) having a sub-array S(X); 

Figure 4B is a generalized diagram of the photosensor array PA(N,M) and sub-arrays S(0), S(1), S(2) and S(3); 

Figure 5 is another schematic diagram of the photosensor array commonly located on a light sensing and logic cir- 
50 curt; 

Figure 6 is a schematic block diagram of the automatic rearview mirror system; 

Figure 6A is a schematic block diagram of the automatic rearview mirror and vehicle interior monitoring system; 

55 

Figure 7 is a flow chart illustrating the method of the present invention for controlling the reflectance of a rearview 
mirror or mirrors; 

Figures 8A and 8B are detailed flow charts for steps S150, S160 and S180 of Fig. 7; 



5 



EP0 788 947 A1 



Figure 9 is a flow chart of the general logic f tow of Figs. 7, 8A and 8B for controlling the reflectance of three mirrors; 
and 

Figure 1 0 is another schematic block diagram of the automatic rearview mirror system of the present invention. 

5 

Figure 1 0A is a schematic block diagram of the automatic rearview mirror and/or vehicle interior monitoring system 
of the present invention. 

Figure 1 1 A illustrates the normalized spectral response of the photosensor array made using a non-epitaxial silicon 
w process. 

Figure 11B illustrates the normalized spectral response of the photosensor array made using an epitaxial silicon 
process. 

is Figure 1 2 is a flow chart illustrating the method of the present invention of the vehicle interior monitoring system. 

Figure 12A is a flow chart illustrating the method of the present invention for a vehicle intrusion detection system 
configuration of the vehicle interior monitoring system of Fig. 12. 

20 Figure 1 2B is a flow chart illustrating the method of the present invention for the compartment image data storage 
system configuration of the vehicle interior monitoring system of Fig. 1 2. 

DETAILED DESCRIPTION OF PREFERRED EMBODIMENT 

25 I. The Automatic Rearview Mirror System 

Figure 1 A illustrates an automatic rearview mirror 1 comprising a variable reflectance mirror element 1a and a sin- 
gle rearwardly facing photosensor 2. The photosensor 2 is mounted facing rearwardly of the rearview mirror 1 so that 
its field of view encompasses an area comprising a rear window area and at least a portion of either or both side window 

30 areas. Also shown is a switch 3 to allow a driver to manually control several possible mirror functions, such as an on-off 
control switch, a sensitivity adjustment and a force-to-day or a force-to-night switch (i.e., forced maximum or minimum 
reflectance levels, respectively). An expanded view of the photosensor 2, which is preferably located in an upper center 
area of the variable reflectance mirror element 1a as shown, shows a light sensing and logic circuit 26 comprising a 
photosensor array 32 and a logic and control circuit 34 (which is not shown in Fig. 1 A but is shown in Figure 6 as dis- 

35 cussed below). A photosensitive surface of each of the photosensor elements 32a (shown in Fig. 5) of the photosensor 
array 32 senses light levels or image information in a predetermined field of view encompassing an area located rear- 
wardly of the rearview mirror 1 . A lens 30 images or otherwise focuses the light information from the predetermined field 
of view onto the photosensor array 32. 

The rearview mirror 1 further comprises a channel mount 1b or other mounting means used to fixedly attach the 

40 mirror 1 to the windshield or headliner area of the vehicle. The rearview mirror 1 is generally adjustable with respect to 
the channel mount 1a to allow a driver to position the mirror for correct viewing of the rearward area or scene so that 
the driver's sightline through the rearview mirror 1 is aligned approximately with the vehicle's centerline. 

Preferably, the photosensor 2 is fixedly mounted on the adjustable portion of the rearview mirror 1 as shown in both 
Figs. 1 A and 1 B so that the viewing axis of the photosensor 2 is generally aligned with the viewing axis of the mirror 1 

45 which is perpendicular to the glass surface of the mirror 1 . This approach is preferable both because of packaging con- 
cerns and because it provides a guaranteed sightiine. It is, however, within the scope of the present invention to mount 
the photosensor array 32 so that it is movable with respect to the variable reflectance mirror element 1a of the rearview 
mirror 1. 

More preferably, as shown in Fig. 1 A, the photosensor 2 is located in the upper center area of the variable reflect- 
so ance mirror element 1a. This may be required, for example, if it is necessary to reduce the bezel size of the rearview 
mirror 1 . If the photosensor 2 is located behind a glass surface of the variable reflectance mirror element 1a, an appro- 
priately sized hole is provided in the protective and reflective materials of the variable reflectance mirror element 1a. 
Additionally, a corresponding area within an active layer of the variable reflectance mirror element 1a may be removed 
or otherwise rendered inactive to enable the photosensor 2 to view directly the rearward scene. Alternatively, for man- 
55 ufacturing reasons, the photosensor 2 may view the rearward scene through the active layer of the variable reflectance 
mirror element 1a, in which case it is preferable to compensate for or otherwise negate the effects of reducing reflect- 
ance and correspondingly the transmittance of the variable reflectance mirror element 1a so that the photosensor 2 
effectively views the rearward scene directly as will be described later. 

Most preferably, a reflective surface is maintained within the hole to both preserve the cosmetic appearance of the 
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assembly as viewed by the driver and to maximize the reflective surface. This can be achieved by providing a very thin 
metal reflective layer (100 A thickness or lower) of aluminum, stainless steel, chromium, or silver, etc., so as to be suf- 
ficiently transmitting for incident light to enable proper operation of the photosensor array 32 but also sufficiently reflec- 
tive to appear mirror-like in the area of the hole. Alternatively, a reflective tape, which is both sufficiently transmitting and 

5 reflective to achieve the objectives described herein, may be adhered at the hole region using suitable means such as 
an optical adhesive and the photosensor array 32 may then be mounted behind the optical adhesive. Additionally, thin 
film stacks such as a solid state tri-layer of Vi wave Ti0 2 , Vi wave Si0 2 and Va wave Ti0 2 or some other single thin film 
of a high index material may be mounted behind or coated upon the area of the hole. Finally, since the preferred pho- 
tosensor array 32 is responsive to both visible light and near infrared, it is preferable to select a material which reflects 

,o a significant proportion of visible light while being essentially transparent to infrared. 

As shown in Figure 1 B, the photosensor 2 may also be located in the bezel or chin of the rearview mirror 1 to view 
the rearward area directly without any compensation. Although not shown, the photosensor 2 may also be located on 
or near the channel mount 1b so that the axis of the photosensor 2, which is perpendicular to the plane of the photo- 
sensor array 32, is in fixed alignment with the vehicle's centerline regardless of the adjusted position of the rearview 

is mirror 1. 

For other vehicles, such as trucks, the photosensor 2 may also be located with each of the external side view mir- 
rors as will be described later. 

The lens 30 is preferably a single molded plastic lens approximately 2 millimeters in diameter and is preferably 
bonded to or in close contact with the photosensor array 32. The lens 30 may, however, include any appropriate image 

20 focusing means such as conventional single component optics, holographic lens type optics, binary optics or a micro- 
lens. The lens 30 preferably is also designed to focus an image of the rearward scene within a field of view defined by 
a cone. The cone's centerline is perpendicular to the plane of the photosensor array 32 and the cone preferably has an 
included angle of approximately 100 degrees. Thus, the image is focused onto a circular area of the plane of the pho- 
tosensor array 32. Of course, the photosensor array 32 could be positioned in other than a rearwardly facing direction 

25 so long as appropriate lenses or other optics are used to direct the light or image information from the rearward area 
onto the photosensitive surface of the photosensor array 32. 

The pre-positioning of the photosensor array 32 in the rearview mirror 1 depends on whether the automatic rear- 
view mirror system 20 is being used in a left hand or a right hand drive vehicle. In either case, the photosensor array 32 
is preferably pre-positioned within the circular area of the focused image so that for either a left or right hand drive vehi- 

30 cle and with only driver adjustment of the rearview mirror 1 , the rearward scene imaged onto the photosensitive surface 
of the photosensor array 32 includes the rear window area and at least a portion of the left and right side window areas 
of the vehicle. 

If a sufficiently large photosensor array 32 is used, then the pre-positioning of the photosensor array 32 is not vehi- 
cle specific as described above, and a system 20 using a larger photosensor array 32 may be used for both left and 

35 right hand drive vehicles. The larger photosensor array 32 is positioned symmetrically within the circular area of the 
focused image described above. 

Using the larger photosensor array 32 involves using a pattern recognition means to determine the approximate 
vehicle centerline so that the appropriate portion of the larger photosensor array 32 may be selected depending on 
whether the automatic rearview mirror system 20 is installed in a left or right hand drive vehicle. 

40 Figure 2 illustrates an automatic rearview mirror system 20 for an automotive vehicle, comprising the rearview mir- 
ror 1, a left side view mirror 4 and a right side view mirror 5. As will be discussed below, either or both of the side view 
mirrors 4 and 5 may be connected to a control circuit of the rearview mirror 1 . The mirrors 1 , 4 and 5 may be constructed 
according to any of the methods known to those skilled in the art and are generally constructed according to the styling 
preferences and specifications of the automotive vehicle manufacturers. The means for mounting the rearview mirror 1 , 

45 such as the channel mount 1b, and the electrical connectors used to connect the mirrors 4 and 5 to the control circuit 
of the rearview mirror 1 and the vehicle's electrical system may include any one of the many configurations known to 
those having ordinary skill in the art. The variable reflectance mirror element 1a of the mirrors 1, 4 and 5 may be any 
device having more than one reflectance level corresponding to a specific control or drive signal. Preferably, however, 
the variable reflectance mirror element 1a is an electrochromic mirror. 

so As discussed, the photosensor 2 is mounted facing rearwardly of the rearview mirror 1 so that its field of view 
encompasses an area comprising the rear window area and at least a portion of both the left side window area and the 
right side window area. The horizontal and vertical fields of view of the rearward area as seen by the photosensor 2, 
and more particularly by the photosensor array 32, are illustratively shown in Figures 3A and 3B. 

As shown in Fig. 3 A, the photosensor array 32 senses a field of view divided into three separate zones: a center 

55 zone a, a left zone b (generally corresponding to the left side window area) and a right zone c (generally corresponding 
to the right side window area). Each zone is sensed by a separate set or sub-array S(X) of photosensor elements 32a 
(described with respect to Figs. 4A and 4B) within the photosensor array 32. The center zone, zone a, generally 
receives light from the rear window area of the vehicle. This rear window area is depicted by a trapezoidally shaped rear 
window figure superimposed on a first set or sub-array S(1) of photosensor elements 32a used to sense light levels in 



7 



EP0 788947A1 



zone a. Zone b includes light from at least a portion of a left side window area. This is depicted by a trapezoidally 
shaped left rear side window figure and a partially shown left front side window figure superimposed on a second set 
or sub-array S(2) of photosensor elements 32a used to sense light levels in zone b. similarly, zone c includes light from 
at least a portion of a right side window area. This is depicted by a trapezoidally shaped right rear side window figure 

s and a partially shown right front side window figure superimposed on a third set or sub-array S(3) of photosensor ele- 
ments 32a used to sense light levels in zone c. Additionally, all three zones include light reflected from whatever fixed 
body work and interior trim, head rests, vehicle occupants or other objects that are within the zones a, b and c. 

Also as illustratively shown in Fig. 3A, the photosensor elements 32a in columns 1 to 4 comprise the third photo- 
sensor element set in zone c, the photosensor elements 32a in columns 6-1 1 comprise the first photosensor element 

10 set in zone a and the photosensor elements 32a in columns 1 3 to 1 6 comprise the second photosensor element set in 
zone b. Null zones are provided between the zones a and b and between the zones a and c to allow for driver adjust- 
ment of the rearview mirror 1 . These null zones also ensure that the center zone a does not include light or other image 
information from the side window areas of zones b and c. 

As will be discussed in more detail below, the logic and control circuit 34 selects photosensor element signals from 

is the first photosensor element set or sub-array S(1 ) (shown in Fig. 4B) corresponding to zone a to control the reflectance 
level of the rearview mirror 1 . Similarly, the control circuit 34 selects photosensor element signals from the second pho- 
tosensor element set sub-array S(2) (shown in Fig. 4B) corresponding to zone b to control the reflectance level of the 
left side view mirror 4, and further selects photosensor element signals from the third photosensor element set or sub- 
array S(3) (shown in Fig. 4B) corresponding to zone c to control the reflectance level of the right side view mirror 5. Addi- 

20 tionally, for a variable reflectance mirror element 1a having segments, such as a center, left and right segment, appro- 
priately defined zones a, b and c, i.e., sub-arrays S(1), S(2) and S(3), corresponding to the mirror segments may be 
used by the logic and control circuit 34 to control independently the individual mirror segments. 

Figure 3B illustratively shows the preferred embodiment for the zones of the photosensor array 32. In this embod- 
iment, the logic and control circuit 34 selects photosensor element signals from three overlapping sets or sub-arrays 

25 S(1), S(2) and S(3) of photosensor elements 32a corresponding to the three overlapping zones a, b and c to control, 
respectively, the reflectance level of the mirrors 1, 4 and 5. More specifically, the control circuit 34 selects photosensor 
element signals from the photosensor elements 32a in columns 6 to 1 1 (zone a) to control the reflectance level of the 
rearview mirror 1. The control circuit 34 also selects photosensor element signals from photosensor elements 32a in 
columns 10 to 14 (zone b) to control the reflectance level of the left side view mirror 4, and further selects photosensor 

30 element signals from photosensor elements 32a in columns 3 to 7 (zone c) to control the reflectance level of the right 
side view mirror 5. 

Additionally, in the Fig. 3B embodiment, the lens 30 focuses or images light information from: (1) the rear window 
area onto zone a; (2) at least a portion of the rear window and left side window areas onto zone b; and (3) at least a 
portion of the rear window and right side window areas onto zone c. Contrastingly, in the Fig. 3A embodiment, the lens 

35 30 focuses light from: (1) the rear window area onto zone a; (2) the left side window area onto zone b; and (3) the right 
side window area onto zone c. The overlapping zones in the Fig. 3B embodiment are advantageous because each set 
of overlapping photosensor elements 32a in zones a and b and each set of overlapping photosensor elements 32a in 
zones a and c, as well as the logic and control circuit 34, is able to "preview" the light information that may, for example, 
first appear in the rear window area (and correspondingly in the rearview mirror 1), but which may appear shortly there- 

40 after in the left or right side view mirrors 4 and 5. By examining at least a portion of the rear window area, the automatic 
rearview mirror system 20 is able to more quickly respond to annoying glare light from approaching vehicles or other 
sources. Overlapping zones are also generally preferred because a glare light source located in a common or overlap- 
ping area of the rearview mirror 1 and one of the side view mirrors 4 or 5 can influence both mirrors. 

45 II. The Light Se nsing DqvipQ 

The light sensing device of the light sensing and logic circuit 26 is preferably the photosensor array 32 shown in Fig. 
5. The photosensor array 32 has sufficient resolution to view the real image of a scene but may also use a spatial dis- 
tribution of light intensities as an approximation of the imaged scene. An example of such a photosensor array 32 is the 
so VLSI Vision Umited (WL) Single Chip Video Camera Model #ASIS 1011. 

Since a photosensor array 32 of the type described, namely the WL Single Chip Video Camera, is capable of pro- 
viding image information having sufficient resolution for displaying an actual image or for some other purpose, it will be 
readily understood that additional features or functions may be incorporated by adding circuitry to provide video output 
from the photosensor array 32 in addition to the primary control functions described herein. For example, the video out- 
55 put may be output to a CRT, flat LC panel display or other appropriate display device, located within the vehicle, to pro- 
vide a display of the imaged scene for viewing by the driver. 

The photosensor array 32 may be located in any of the mirrors 28 or in any other appropriate location, whether local 
or remote, such as on the vehicle's rear bumper, thereby extending significantly the effective field of view normally avail- 
able to the driver either directly or through the vehicle's mirrors 28. Additionally, the photosensor array 32 may even 
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replace one or more of the side view mirrors 4 and 5 of the automatic rearview mirror system 20, thereby reducing the 
aerodynamic drag on the vehicle while providing sufficient information to the driver comparable to that available through 
the side view mirrors 4 and 5. 

A video signal from the photosensor array 32 may also be used by the logic and control circuit 34 to determine the 

5 presence of a vehicle or other object within the field of view of the photosensor array 32 to provide a visual signal warn- 
ing such as through a display panel, or even an audible warning, based on certain parameters, such as distance and 
speed of the object. Additionally, if the photosensor array 32 is located in the rearview mirror 1 , the video signal may be 
used to monitor the vehicle's interior to detect unauthorized intrusion into the vehicle. This may be achieved by providing 
electrical power to the mirror's logic and control circuit 34 from a vehicle power supply and by activating a vehicle intru- 

10 sion monitoring mode when a signal indicates that the vehicle's door and trunk locks have been activated. The logic and 
control circuit 34 may be used to continuously monitor the image from the vehicle's interior thereby allowing detection 
of objects or persons moving within the vehicle, and if movement is detected, another signal from the logic and control 
circuit 34 may then activate an intrusion alarm. 

Thus, the photosensor array 32 may be used to monitor the vehicle interior or compartment in a vehicle interior 

15 monitoring system. This monitoring capability may be used in a vehicle intrusion detection system or in a compartment 
image data storage system, either in combination with the automatic rearview mirror system or as an independent sys- 
tem. Using the photosensor array 32 to monitor the vehicle interior to detect potential intruders provides an effective 
vehicle intrusion detection system. In an automatic rearview mirror and vehicle intrusion detection system, the photo- 
sensor array 32 in the rearview mirror 1 provides a good location for monitoring the vehicle interior because the rear- 

20 view mirror 1 is: (1) centrally located along the vehicle axis; (2) forward of the front seat; and (3) relatively high in the 
vehicle interior. This location is sufficiently high and far forward so as to provide a very good view of the vehicle interior, 
including the front and rear seat areas, front and rear door areas and hatchback or rear cargo door areas. The photo- 
sensor array 32 may also be positioned in other locations, including the headliner and headliner console areas, for 
example, or any other appropriate location depending on the particular application. 

25 As is discussed later, when the vehicle interior monitoring system is used as a vehicle intrusion detection system, 
the logic and control circuit 34 processes image data to detect motion or movement in the vehicle interior, establishes 
an intrusion condition if such motion is detected and outputs one or more control signals to vehicle hardware or to a 
vehicle controller system. Vehicles today are often equipped with such controller systems. These vehicle controller sys- 
tems may be used to control the exterior lights, interior lights, horn (or siren), ignition or other such vehicle hardware. 

30 The logic and control circuit 34 therefore outputs one or more control signals to various vehicle hardware or to the vehi- 
cle controller system to activate the interior and exterior lights, horn or siren or to disable the ignition to deter intruders 
from stealing the vehicle or its contents. Other control output signals may activate RF beacon devices or similar devices 
within the vehicle so that the vehicle may be tracked, as will be further described later. 

It is, however, within the scope of the present invention for the light sensing device to comprise any similarly appro- 

35 priate image or array sensor. When the light sensing and logic circuit 26 is formed as a very-large-scale-integrated 
(VLSI) complementary-metal-oxide-semiconductor (CMOS) device, as is known to those skilled in the art, the light 
sensing device will share a common semiconductor substrate with the logic and control circuit 34. 

Preferably, for the described three mirror system, the photosensor array 32 comprises a plurality of photosensor 
elements 32a arranged in 160 columns and 40 rows (a 160 x 40 array) providing a horizontal field of view of approxi- 

40 mately 1 00 degrees and a vertical field of view of approximately 30 degrees. As discussed, Figs. 3A and 3B illustratively 
show a 16 x 4 photosensor array 32. The photosensor array 32 may, however, comprise any appropriately sized array 
having an appropriate field of view. For example, the field of view may be narrower when controlling the segments of 
only one mirror. Each photosensor element 32a is preferably about 10 microns square. 

As shown in Figure 4A, the photosensor array 32 generally comprises a plurality of photosensor elements 32a 

45 arranged in a photosensor array PA(N,M) having N rows of M columns. When viewing the photosensitive surface of the 
photosensor array PA(N.M) in a vertical plane, the lower row is row 1 , the top row is row N, the left hand column is col- 
umn 1, and the right hand column is column M. A specific photosensor element is identified as E(n,m) and the signal 
indicative of a light level incident thereon is L(n,m). Also, the sub-array S(X), where X = 0, 1 , 2, . . ., Z, is a rectangular 
array having P(X) rows of Q(X) columns of photosensor elements 32a and is located such that its lower left hand ele- 

so ment is photosensor element E(T(X) , U(X)) . 

As shown in Figure 4B, a background sub-array S(X) designated S(0) is used to determine a general background 

light level B. Signals from the photosensor elements 32a of each peak sub-array S(X), designated S(1), S(2) S(Z), 

are used to determine a peak light level P(z) incident on each peak sub-array S(1), S(2) S(Z). The general back- 
ground light level B for background sub-array S(0) and the peak light level P(z) for each peak sub-array S(X) are then 

55 used to determine a mirror control signal V c (z) for controlling at least one mirror or mirror segments associated with 
each zone. 

Figure 5 generally illustrates a logic layout of the photosensor array 32. The logic and control circuit 34 generates 
array control signals to control the photosensor array 32. As is well known in the art, the photosensor array 32 is typi- 
cally accessed in scan-line format, with the array 32 being read as consecutive rows, and within each row as consecu- 
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tive columns or pixels. Each photosensor element 32a is connected to a common word-line 33e. To access the 
photosensor array 32, a vertical shift register 33a generates word-line signals for each word-line 33e to enable each row 
of photosensor elements 32a. Each column of photosensor elements 32a is connected to a bit-line 33f which is con- 
nected to a charge-to-voltage amplifier 33c. As each word-fine 33e is accessed, a horizontal shift register 33b uses a 

5 line 33g to output the bit-line signals on consecutive bit-lines 33f to an output line 33h connected to the logic and control 
circuit 34. Also shown is a voltage amplifier 33d used to amplify the resulting analog photosensor element signals. The 
analog photosensor element signals are then output on line 33h to the analog-to-digital converter 44 and converted to 
digital photosensor element signals. 

As discussed above, the photosensor array 32 is responsive to or senses both visible light and near infrared illumi- 

w nation. Figures 1 1 A and 11 B illustrate the normalized spectral response for two versions of the preferred photosensor 
array 32. In Figs. 11 A and 1 1 B, visible light generally covers the wavelengths from about 400 nm to about 750 nm, while 
near infrared illumination or light generally covers the wavelengths from about 750 nm to about 3000 nm (not shown). 
More particularly, Fig. 11A illustrates the normalized spectral response of the preferred photosensor array 32 made 
using a non-epitaxial silicon process, where the peak spectral response occurs at about 800 nm. Figure 1 1 B shows the 

is normalized spectral response of the preferred photosensor array 32 made using an epitaxial silicon process, where the 
peak spectral response occurs at about 650 nm. As shown, the non-epitaxial silicon photosensor array is more sensitive 
to near infrared illumination having wavelengths on the order of about 800nm. The photosensor array 32 made using 
the non-epitaxial silicon process and having the normalized spectral response of Fig. 1 1 A is most preferred in both the 
particular automatic rearview mirror and vehicle interior monitoring systems described herein. For automatic rearview 

20 mirror systems as described herein, this is because vehicle headlights generally provide significant levels of near infra- 
red illumination. For vehicle interior monitoring systems as described herein, either natural sources (such as sunlight) 
or supplemental sources of near infrared illumination may be used to enhance the image information available to and 
the performance of such systems, as will be further discussed below. 

The field of view and resolution of the photosensor array 32 depends on the number and physical dimensions of 

25 the photosensor elements 32a and on the design or geometry of the lens 30. For the lens type illustrated in Fig. 1 A, the 
lens 30 may, for example, be designed to have an included angle in the order of up to about 140°. For the automatic 
rearview mirror system previously described, the effective field of view of approximately 100° horizontal and approxi- 
mately 30° vertical is preferred. For the automatic rearview mirror and vehicle interior monitoring system described 
herein, an effective field of view of approximately 100° horizontal and approximately 75° vertical is preferred. Also as 

30 discussed for the automatic rearview mirror system, the lens 30 preferably focuses an image within a field of view 
defined by a cone having an included angle of approximately 100 degrees. Accordingly, when the lens 30 focuses the 
image onto the focal plane of the 160 x 40 photosensor array 32, the photosensor array 32 only falls within a segment 
of the focused image area. 

Figure 2A generally illustrates a view of a vehicle interior 100 (which includes the window areas of Figs. 3A and 3B) 

35 as focused by the lens 30 and as viewed by a 1 60 x 1 20 photosensor array 32. Also shown are a driver or left seat 101, 
a front passenger or right seat 1 02, a rear window area 103a, a right side window area 1 03b and a left side window area 
103c. The 160 x 40 photosensor array 32, however, only sees a portion or segment of the vehicle interior 100, as is 
shown in Figs. 3A and 3B. In a dedicated automatic rearview mirror system, the 160 x 40 sized array is generally pre- 
ferred since it provides sufficient image information for providing effective automatic rearview mirror control and 

40 because it reduces the cost of the photosensor array 32. If the photosensor array 32 is also used to monitor the vehicle 
interior 100 (or for other applications) as is described herein, then the larger 160 x 120 array size may be used to view 
the vehicle interior 100 as is generally illustrated in Fig. 2 A. 

Finally, it should be understood that the spatial resolution of the photosensor array 32 may also be increased. This 
may be done by making the photosensor elements 32a smaller so as to increase the number of photosensor elements 

45 32a in a photosensor array 32 having the same physical dimensions. Additionally, spatial resolution may be increased 
by varying the lens 30 to decrease the included angle of the image cone so that the photosensor array 32 views a 
smaller portion of an image on the vehicle interior 100. 

In summary, the array size of the photosensor array 32 and the number and physical dimensions of the size of the 
photosensor elements 32a and the lens design or geometry of lens 30 may all be varied to optimize the effective field 

so of view of the photosensor array 32 depending on the application. 

As is discussed later, an exposure time or exposure period EP of the photosensor array 32 may be varied over 
some range depending on the light level. Thus, the value of EP is increased for decreasing light levels and approaches 
a maximum for low light levels, and it is decreased for increasing light levels and approaches a minimum for high light 
levels. For a given value EP V of the exposure period, there is a light level LL^ that is sufficiently distinct from low signal 

55 noise in the photosensor element signal L(n,m) of each photosensor element E(n,m) so that it may be accurately 
sensed, and there is also a light level LL MAX for which the photosensor element signal L(n,m) of each photosensor ele- 
ment E(n,m) is a maximum. The ratio of LL MA x/LLmin at EP V may be used to represent a dynamic range of DR(n,m) in 
decibel (dB) units of each photosensor element E(n,m), where DR(dB) = 10 LOG (LL MAX /LL MIN ) . The image data is 
preferably optimized such that it is approximately centered within the dynamic range DR(N,M) of the photosensor array 
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32. This may be done by determining an array response AR of RA(N.M), which is described later, where the minimum 
and maximum digital values of AR correspond to the minimum and maximum digital values possible for Val RA(n,m) 
(e.g., 0 and 255 for 8-bit data resolution). Tlie exposure period is varied or adjusted until AR approaches the center or 
mid-point of the possible data value range (e.g., 127 for 8-bit data resolution). 

s Since there is a minimum photosensor element signal that may be accurately measured, a supplemental source of 
illumination may be desirable or necessary to enhance the effective sensing capabilities of the photosensor array 32 by 
providing supplemental source illumination SSI. Although the photosensor array 32 is able to monitor the vehicle interior 
100 over a range of background lighting levels from about 0.1 lux (a dark garage) to about 30-60 K lux (a bright, sunny 
day), using either visible or near infrared SSI to illuminate the vehicle interior 100 generally (or specific areas therein) 

w significantly enhances the effectiveness or performance of the photosensor array 32 in various applications. Also, SSI 
is preferably provided only during the exposure period EP of the photosensor array 32 rather than continuously. Pulsed 
SSI reduces power consumption, extends the life of the supplemental source of illumination and provides generally 
higher instantaneous illumination than may be provided by continuous illumination. Also, pulsed infrared SSI is gener- 
ally more difficult to detect by infrared illumination sensing apparatus that may be used by potential intruders. 

is For the specific vehicle interior monitoring system applications described herein, near infrared illumination between 
about 700 and 1200 nm is preferred because: (1) it is visible to the photosensor array 32 but not to the human eye (see 
Figs. 1 1 A and 1 1 B); and (2) it does not affect adaption of the human eye. There are a number of readily available near 
infrared illumination sources, including solid-state sources such as light emitting diodes (LEDs) and lasers, flash lamps 
such as xenon or krypton lamps, incandescent lamps such as tungsten lamps, as well as many others. Preferred, how- 

20 ever, are gallium arsenide (GaAs) or gallium aluminum arsenide (GaAIAs) LEDs because they provide a relatively nar- 
row band (about 750 to 950 nm) of near infrared illumination (see Figs. 1 1 A and 1 1 B). Such illumination sources are 
also typically packaged with a lens to distribute the illumination. Depending on the particular application, the illumination 
distribution characteristics of readily available lens/source packages may range from narrow so as to provide spot or 
collimated illumination to very diffuse so as to cover about 160°. In the vehicle interior monitoring system described 

25 herein, the lens/source package preferably provides illumination coverage on the order of about 100°. 

Other illumination sources providing broad-band illumination (ultraviolet through infrared) may also be used, but it 
may be desirable or necessary to filter such broad-band illumination using absorption or interference type filters, or any 
other appropriate filter. In particular, an interference filter known as a long-wave pass filter or cold mirror reflects visible 
light, transmits infrared illumination and looks like the normal silvered mirrors typically used in the rearview mirror 1. 

30 Unlike cold mirrors, however, silvered mirrors reflect near infrared illumination. Since the cold mirror resembles the sil- 
vered mirror in the rearview mirror 1, it may be used to replace a section or even all of the silvered mirror. In particular, 
the supplemental source of illumination may be located behind the cold mirror element and adjacent to the photosensor 
array 32 with an opaque barrier separating the two to prevent supplemental illumination reflections within the rearview 
mirror 1 from directly affecting the photosensor array 32. 

35 Alternatively, a long-wave pass absorption filter may be used with a supplemental source of broad-band infrared 
illumination. Long-wave pass absorption filters may be fabricated using a wide variety of polymers having appropriate 
optical transmission characteristics such as epoxies, acrylics, polycarbonates, as well as a variety of glasses. The 
acrylic and polycarbonate polymers are preferred because they are environmentally stable, cost effective and because 
they may be used to injection mold parts having various geometric shapes or polished or textured surfaces. Using 

40 absorption filter materials, the photosensor array 32 and supplemental source of illumination may be integrated into the 
rearview mirror 1 or elsewhere within or on the vehicle so that they are not readily apparent to vehicle occupants, pas- 
sers-by or potential intruders. 

III. The Logic And Control Circuit 

45 

Figure 6 shows the light sensing and logic circuit 26 comprising the photosensor array 32 and the logic and control 
circuit 34. The logic and control circuit 34 comprises a logic circuit 46, a clock 47, a random-access-memory (RAM) 50, 
or other appropriate memory, and a digital-to-analog converter 52. The logic circuit 46 is preferably a dedicated config- 
uration of digital logic elements constructed on the same semiconductor substrate as the photosensor array 32. Alter- 
so natively, the logic circuit 46 may also be a microprocessor comprising a central processing unit (CPU) and a read-only- 
memory (ROM). The logic circuit 46 may also be implemented using gate array technology or any other appropriate 
hardwired logic circuit technology. 

The logic circuit 46 interfaces with the clock 47, provides array control signals to the photosensor array 32, man- 
ages data flow to and from the RAM 50 and converters 44 and 52, and performs all computations for determining a dig- 
55 ital mirror control signal Vq^Z) for causing the variable reflectance mirror element 1 a to assume a desired reflectance 
level. As discussed, the analog-to-digital converter 44 converts the analog photosensor element signals to the digital 
photosensor element signals processed by the logic circuit 46. It has been found that an eight-bit analog-to-digital con- 
verter 44 provides adequate data resolution for controlling the mirrors 1, 4 and 5. Preferably, the analog-to-digital con- 
verter 44 is constructed on the same semiconductor substrate as the photosensor array 32 as shown in Fig. 5. 
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The digital photosensor element signals output to the logic and control circuit 34 are generally stored in the RAM 
50 for processing. The values of the digital photosensor element signals for the photosensor array PA(N.M) are corre- 
spondingly stored in an array in the RAM 50 designated RA(N,M). The logic circuit 46 processes the values of each of 
the digital photosensor element signals, which are designated Val RA(n,m), to determine an instantaneous or substan- 

5 tially real-time background light signal B t for a time period t and at least one peak light signal P(z). The logic circuit 46 
uses these signals, which may also be temporarily stored in the RAM 50, to determine a digital control signal V DAC (z) 
to cause at least one mirror or mirror segment to assume a desired reflectance level. The digital mirror control signal 
Vdac( z ) is ^ en output to the digital-to-analog converter 52, which outputs a corresponding analog mirror control signal 
V c (z) to a mirror drive circuit 24. Alternatively, the digital-to-analog converter 52 need not be used if the logic circuit 46 

w generates a pulse-width-modulated (PWM) mirror control signal to control the mirror drive circuit 24. 

The mirror drive circuit 24 comprises mirror drive circuits 24a, 24b and 24c. The drive circuit 24 drives mirrors 28, 
which comprises a rearview mirror 28a (mirror A), a left side view mirror 28b (mirror B) and a right side view mirror 28c 
(mirror C). Mirrors A, B and C correspond, respectively, to the rearview mirror 1 , the left side view mirror 4 and the right 
side view mirror 5 shown in Fig. 2. It is, of course, within the scope of the present invention for the mirror A to be a mirror 

15 other than the rearview mirror 1 . It is similarly within the scope of the present invention for the mirror B to be a mirror 
other than the left side view mirror 4, and for the mirror C to be a mirror other than the right side view mirror 5. It is also 
within the scope of the invention for the mirrors A, B and C to be mirror segments or zones of the variable reflectance 
mirror element 1a where the peak sub-array S(X) for each zone corresponds to a segment of the variable reflectance 
mirror element 1a. Thus, for example, S(1) may correspond to a center mirror segment, S(2) may correspond to a left 

20 mirror segment and S(3) may correspond to a right mirror segment. Any other appropriate mirror segmentation scheme 
may also be used. 

A sensitivity control circuit 42 is used to input a sensitivity signal S to the logic and control circuit 34. In addition, 
signals from a force-to-day (maximum reflectance) switch 36, a reverse-inhibit (maximum reflectance) switch 38 and a 
force-to-night (minimum reflectance) switch 40 may also be input to the logic and control circuit 34. The switch 3 of Figs. 
25 1 A and 1B may include the sensitivity control circuit 42, as well as the force-to-day switch 36 and the force-to-night 
switch 40. 

The switches 36, 38 and 40 each generate a signal causing the logic circuit 46 to override its normal operation, as 
will be described with respect to Figs. 7, 8A and 8B, and to output mirror control signals V c (z) to the mirror drive circuit 
24 causing the variable reflectance mirrors 28 to assume a maximum or minimum reflectance level in accordance with 

30 the appropriate signals from the switches 36, 38 or 40. 

Finally, the logic and control circuit 34 may also be used to control a vehicle lighting switch 45 to automatically turn 
on and off a vehicle's headlights and sidelights. This feature will be further described later. 

Figure 6A shows the block schematic diagram of the automatic rearview mirror and vehicle interior monitoring sys- 
tem. The previous description of Figure 6 applies here except as follows. First, the logic and control circuit 34 includes 

35 an analog-to-digital converter 55 for converting one or more analog control input signals 70 (1 , 2 N; blocks 70a to 

70n) to digital signals that are input to the logic circuit 46. 

With respect to the automatic rearview mirror system, the analog control input signals 70 may include any analog 
control input signal used therein, including, for example, analog versions of the control input signals provided by the 
fbrce-to-day-switch 36, reverse-inhibit-switch 38, force-to-night-switch 40 or sensitivity control circuit 42 of Fig. 6. Of 

40 course, digital versions of these same control input signals may also be input to the logic circuit 46 as digital control 

input signals 75 (1 , 2 N; blocks 75a to 75n). The analog control output signals 80 (1 , 2 N; blocks 80a to 80n) 

may include any analog control output signal used in the automatic rearview mirror system, including the analog mirror 
control signals V c (z). The analog circuits/switches 81 (1 , 2 N; blocks 81a to 81 n) may include the drive mirror cir- 
cuits 24 that are used to drive the variable reflectance mirrors 28. As discussed with respect to Fig. 6, the analog mirror 

45 control signal V c (z) is output to the mirror drive circuit 24 causing the variable reflectance mirror 28 to change reflect- 
ance levels. Of course, digital control output signals 85 (1 , 2 N; blocks 85a to 85n) may also be output to digital 

circuits/switches 86 (1 , 2, .... N; blocks 86a to 86n) to the extent that the control output signals are digital and not ana- 
log. 

With respect to the vehicle interior monitoring system configured as a vehicle intrusion detection system, analog 
so control input signals 70 and digital control input signals 75 may include, respectively, analog and digital versions of con- 
trol input signals used to "arm" or "alert" the vehicle intrusion detection system, as will be further described later. The 
analog control output signals 80 may include any analog control signals output to analog circuits/switches 81 that are 
used in the above system, including analog circuits or switches used to actuate various vehicle hardware, such as the 
vehicle horn (or siren), exterior and interior lights or ignition control devices. Of course, digital control output signals 85 

55 (1,2 N; blocks 85a to 85n) may also be output to digital circuits/switches 86 (1 , 2 N; blocks 86a to 86n) to the 

extent that the control output signals are digital and not analog. In particular, the digital control output signal 85 may 
include a digital word provided to a digital circuit/switch 86 that is a vehicle controller system that interfaces with such 
vehicle hardware. 

When the vehicle interior monitoring system is configured as a compartment image data storage system, a nonvol- 
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atile memory 57, as shown in Fig. 6A, is included. The nonvolatile memory 57 interfaces with the logic circuit 46. The 
nonvolatile memory 57 is used to store image data, as will be further described later. The nonvolatile memory 57 may 
be an EEPROM or other appropriate nonvolatile memory. An access/security decoding logic circuit 58 interfaces with a 
data access port 59 and the logic circuit 46. The access/security decoding logic circuit 58 and data access port 59 are 
5 used to access the image data stored in the nonvolatile memory 57, as will be further described later. Optionally, this 
system may include a data compression logic circuit 56 for compressing image data received from the logic circuit 46 
before it is stored in the nonvolatile memory 57. The data compression logic circuit 56 may be integral with the logic 
circuit 46. 

Finally, whether configured as a vehicle intrusion detection system or as a compartment image data storage sys- 
w tern, the vehicle interior monitoring system preferably includes a supplemental source of illumination 61 having a lens 
62 as shown in Fig. 6A. A supplemental source of illumination drive circuit 60 is connected to the supplemental source 
of illumination 61 . The drive circuit 60 also interfaces with and receives control signals from the logic circuit 46 to drive 
the supplemental source of illumination 61 . 

15 IV. Operation Of The Invention 

Figure 7 shows an overview of the logic flow chart and method for controlling the reflectance levels of any one or 
all of the mirrors or mirror segments 28a, 28b or 28c. It should be understood that the reflectance level of each of the 
mirrors 28a, 28b and 28c in the automatic rearview mirror system of the present invention may be commonly or inde- 

20 pendently controlled. Figures 8A, 8B and 9 provide more detail on the logic and method of Fig. 7. 

In step S101 of Fig. 7, light information seen rearwardly of the rearview mirror 1 is incident on the lens 30. In step 
S1 1 0, light passing through the lens 30 is refracted such that the light information is imaged or focused onto the photo- 
sensitive surface of the photosensor array 32. In step S120, the logic circuit 46 generates and outputs the array control 
signals to the photosensor array 32. In step S130, photosensor element signals indicative of the light levels incident on 

25 each of the photosensor elements 32a are generated. In step S1 40, these photosensor element signals are temporarily 
stored in RAM or any other appropriate memory. In steps S150 and $160, the logic circuit 46 determines values for the 
background light signal and the peak light signal for each zone corresponding to each of the mirrors 28. In step S180, 
the logic circuit 46 uses the background and peak light signals of step S150 to determine the control signals required 
to cause each of the mirrors 28 to achieve a desired reflectance level. Also, the logic and control circuit 34 in step S180 

30 reads and processes the states of the optional sensitivity control circuit 42, force-to-day switch 36, force-to-night switch 
40 and reverse-inhibit switch 38. In step S200, the mirror drive circuits 24 use the control signals determined in step 
S180 to generate drive signals to cause the mirrors 28 to assume the desired reflectance levels in step S210. 

In one embodiment of the invention, the logic circuit 46 determines the background light signal B t in steps S1 50 and 
S160 by calculating the average value of the photosensor element signals, previously stored in RAM in step S140, for 

35 the photosensor elements 32a in a lowest row or rows of the photosensor array 32 corresponding to an area below the 
rear window. With respect to Figs. 3A and 3B, this means that the background light signal B, is determined from photo- 
sensor element signals generated by the photosensor elements 32a located in row D of the photosensor matrix array 
32. The logic circuit 46 may then output B t to the RAM 50 for later processing. The logic circuit 46 may also determine 
B t by calculating an average value of all of the photosensor element signals in the entire photosensor array 32. More 

40 generally, the background fight signal Bt for the rearward scene may be determined by calculating the average value of 
X percent of the lowest photosensor element signal values in the RAM array RA(N,M), where X is preferably 75, but typ- 
ically may be in the range of 5 to 100. Alternatively, an exposure period EP, as is described herein, may be used to 
determine the background light signal B t . An array response AR may be determined using an array average method, as 
is also described herein, for the photosensor element signal values corresponding to a sub-array S(X) of the photosen- 

45 sor elements 32a of the photosensor array 32 that correspond to an area below the rear window. The exposure period 
EP may be varied within an operating point range OP ± R, where OP is 10 and R is 5 (8-bit data), but where OP may 
be from 5 to 1 75 and R may be from 2 to 1 5. The exposure period is varied to maintain AR within OP ± R. The back- 
ground light signal B t may therefore be determined where Bt varies inversely with EP. 

Additionally, the background light signal Bt is preferably change-limited to determine a limited background light sig- 

50 nal B Lt . The signal B t may be change-limited, for example, by limiting changes in the background light signal Bt to 2% 
per time frame. A time frame may be, for example, 250 milliseconds or any other time relating to the rate at which the 
logic circuit 46 samples the photosensor element signals from the photosensor array 32. The logic circuit 46 determines 
the change-limited value B Lt used to determine the digital mirror control signal V DAC (z) as follows: 
B Lt = B L(M) + C L x (B t - B L(M) ) , where B Lt = the change-limited background light signal for a current time frame t, B t 

55 = the actual or substantially real-time background light signal for the current time frame t, B L(t .i) = the change-limited 
background fight signal for a previous time frame (t-1) and C L = the change-limit value. Additionally, the background light 
signal B t from step S1 50 may be processed by the logic circuit 46 to determine whether the change limited background 
light signal B L1 is less than or greater than B L ^y If B Lt is greater than B^), then the logic circuit 46 may use a higher 
change-limit value Cm to determine B Lt . If the background light signal B Lt is less than or equal to B L ( M) , then the logic 
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circuit 46 may use a lower change-limit value C LL to determine B Lt . The values C LH and C LL are in the range of 0.01 to 
2, but are preferably on the order of about 0.02 or 2%. 

The logic circuit 46 in step S150 also determines the peak light signal P(z) for each zone or sub-array S(X) of the 
photosensor matrix array 32. The peak light signal P(z) used to determine the appropriate mirror control signal V c (z) 

5 for the mirror 28 may be determined by counting or summing the number of occurrences where the digital value for a 
photosensor element signal is greater than a peak threshold value F for each zone or sub-array S(X). For the preferred 
analog-to-digital converter having eight-bit data resolution, the logic circuit 46 generates digital values indicative of light 
levels of light incident on each photosensor element 32a in the range of 0 to 255 (2 8 - 1 = 255), with headlights resulting 
in values in the range of about 200 to 255, so that the peak threshold value F is selected to be in the range of about 200 

w to 255 but is preferably 245. The resulting count or sum P(z) provides a measure of the peak light level for the following 
reasons. 

One design objective of the lens 30 and the photosensor array 32 combination is to be able to measure background 
light levels in the approximate range of 0.01 to0.1 lux when driving on sufficiently dark roads. This is achieved by ensur- 
ing that the lens 30, photosensor elements 32a and charge-to-voltage amplifiers 33c are able to measure such light lev- 

15 els and by providing a maximum exposure time. The maximum exposure time determines the operating frequency or 
sampling rate of the system 20. In the case of the described system, 1 .5 MHz has been found to be appropriate. 

By varying the exposure time relative to a general background light level B and using a substantially constant sam- 
pling rate, a wide range of background light levels in the range of 0.01 to 1000 lux can be measured. Thus, when the 
background light level is low, the exposure time is relatively long such that headlights within the rearward area cause 

20 the affected photosensor elements 32a to saturate. Correspondingly, for higher background light levels, the exposure 
time is reduced. Saturation occurs when the incident light charges the photosensor element 32a to capacity so that any 
excess charge will leak or transfer to adjacent photosensor elements 32a. This charge leakage effect is commonly 
referred to as "blooming." It has been found that a count of the number of photosensor elements 32a at or near satura- 
tion, i.e., those having digital values greater than the peak threshold value F, provides an excellent approximation of the 

25 peak light levels and is further described in Fig. 8A. The above described method effectively extends the range of meas- 
urable fight levels for the photosensor array 32. 

As discussed, photosensor element signals are indicative of the incident light level or intensity and the time period 
for which they are exposed to such light. By operating the photosensor array 32 for a known exposure time or exposure 
period EP, the incident light intensity may be determined from the photosensor element signal generated by each pho- 

30 tosensor element 32a. After the exposure period, the logic and control circuit 34 processes all of the photosensor ele- 
ment signals for each photosensor element 32a of the photosensor array 32. This signal processing at least includes 
the process of storing the digital value of each photosensor element signal to obtain RA(N,M), but normally includes all 
other processing for each image data set RA(N,M) up to and including the generation of output control signals, such as 
the mirror control signal V C (Z). The time from the beginning of the exposure period EP through the processing of each 

35 image data set RA(N,M) and the generation of the appropriate output control signals is referred to as the operating or 
sampling period, and the frequency thereof is referred to as the operating frequency or sampling rate. The frequency at 
which the process is repeated may also be referred to as the frame rate or the image sampling frequency. The rate of 
each sub-process (e.g., exposure period) within the sampling period is controlled by the system clock 47. Thus, the 
frame rate or image sampling frequency is essentially fixed for a particular system clock frequency. The total period cor- 

40 responds to a maximum exposure period EP and the total processing time relating to an image data set RA(N,M). The 
system clock frequency may be adjusted to scale-the image sampling frequency, thereby adjusting EP. In summary, the 
maximum exposure period, the operating or sampling period, the signal processing time and the frequency of the sys- 
tem clock 47 should be considered in each application. 

Alternatively, if an anti-blooming device is incorporated in the photosensor array 32, such as is well known to those 

45 skilled in the art, then the peak light signal P(z) may be determined by calculating an average value of Y percent of the 
highest photosensor element signal values for each zone, where Y is preferably 10, but may be in the range of 1 to 25. 
When using this approach for determining P(z), it is also preferable to include logic to adjust the sampling rate or oper- 
ating frequency of the logic circuit 46 to an appropriate value depending on B Lt . 

The general background light signal B, whether B t or B Lt> and the peak light signal P(z) for each zone of the photo- 

so sensor array 32, as determined in steps S1 50 and S1 60, are then used by the logic circuit 46 to determine a mirror con- 
trol signal V G (z) as a function of the ratio of B n (n preferably has a value of one but may typically range from 0.8 to 1 .3) 
to P(z), i.e., V c (z) = f(B n /P(z)) . The control signal V c (z) is then output to the mirror drive circuits 24 in step $180 to 
drive the mirrors 28 or segments thereof to their desired reflectance level in the steps S200 and S210. 
Figure 12 shows the logic flow chart and method for the vehicle interior monitoring system or mode. 

55 In step S301 , the logic circuit 46 initializes the system, sets EP to its maximum and if used, SSI to a predetermined 
minimum, such as zero. Next in step S310, the logic circuit 46 reads any analog control input signals 70 (70a to 70n of 
Fig. 6A) and/or digital control input signals 75 (75a to 75n of Fig. 6A) that may be used in the vehicle interior monitoring 
mode. 

In step S315, the photosensor element signals are generated, processed and stored in RAM 50 by the logic circuit 
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46 (see steps S101 to S140 of Fig. 7). The logic circuit 46 also applies the lens correction factor LC(n.m) to each digital 
value Val RA(n r m) indicative of the photosensor element signal L(n,m) of each photosensor element 32a in the RAM 
array RA(N.M) to correct for the effect of lens 30. This results in RA(N,M) containing the lens corrected digital value Val 
RA LC (n ( m) indicative of the photosensor element signal of each photosensor element 32a. 

5 Next, in step S320, the logic circuit 46 determines the array response AR, which is indicative of either RA(N,M) (an 
entire image data frame or set RA^ t) at time t) or of a selected sub-array or sub-set thereof RS(N S ,M S ) (a partial image 
data frame or set RS (t ) at time t). where N s and M s are the row and column dimensions corresponding to a selected 
sub-array S(X) of the photosensor array 32. The logic circuit 46 processes the image data frame RA< t) using one of the 
methods described below to determine the array response AR. An appropriate operating point range OP ± R is associ- 

10 ated with each AR calculation method. 

The preferred method for determining AR is the array average method, in which the logic circuit 46 determines AR 
by averaging all of the data values Val RA LC (n,m) in the image data frame RA< t) (or selected sub-array RS (t j) where: 

n m 



forn = 1toN,m = 1toM. Using the array average method, it has been found that appropriate OP and R values are 

20 127 and 20 (8-bit data resolution), respectively; however, the operating point range may be non-symmetrical for some 
tasks by using non-symmetrical R values, such as +20 and -10. 

An alternative method is the "no saturation" method, in which EP is set to its highest level at which there is no sat- 
uration or blooming in any photosensor element 32a. In this case, the logic circuit 46 reduces EP until the peak value 
of RA( t ) or RS( t ) is within the operating point range OP ± R. It has been found that appropriate OP and R values are 249 

25 and 5, respectively. Still another method involves maximizing the useful image area, in which the logic circuit 46 deter- 
mines AR by determining the difference between the number of photosensor elements 32a having digital values of 0 
and the number having digital values of 255 (8-bit data resolution). In this case, appropriate OP and R values are 0 and 
5% of the number of photosensor elements 32a corresponding to the image data set RA( t) or sub-array RS (t ). It should 
be understood that the specific values, such as 127 and 255, are based on 8-bit data resolution and would be appro- 

30 priately scaled for other data resolutions. 

In step S330 and S360, it is determined whether AR is in the operating point range OP ± R. If AR is outside the 
range, then the image data frame is either too bright ( AR>OP + R ) or too dim ( AR<OP - R ) and EP and SSI are incre- 
mentally increased or decreased according to steps S340, S341 , S342 or S350, S351 , S352. This is repeated for every 
image data frame RA( t ). The system thus optimizes EP and SSI for the particular circumstances at system startup, and 

35 thereafter continues to adjust EP and SSI to maintain AR within the operating point range OP ± R as lighting conditions 
change. 

If AR is within the operating point range OP ± R, then the vehicle interior monitoring system/mode enters a primary 
task routine or mode in step S370, such as the vehicle intrusion detection system/mode (S400) of Figure 12A or the 
compartment image data storage system/mode (S500) of Figure 12B. After completing the primary task routine, the 
40 program returns to the vehicle interior monitoring mode to generate and store another image data frame RA^. 

V. The Preferred Embodiments 

The general lighting conditions of the rearward scene can be defined as follows: the background light level of the 
45 viewed rearward scene is B and the peak light level for each zone or sub-array S(X) is P(z). A contrast ratio C(z) may 
be defined as the ratio of the peak light level P(z) for each zone to the general background light level B; thus, 
C(z) = P(z)/B . Given the background light level B, the human eye can tolerate varying peak light levels in the viewed 
rearward scene up to a particular contrast ratio tolerance C T . Contrast ratios greater than C T initially cause discomfort 
and are generally known as glare. As the eye adjusts its light sensitivity to protect itself from the discomforting peak or 
so glare light levels, vision is reduced and the glare may become disabling. Thus, the maximum tolerable peak light level 
P T of the viewed rearward scene is equal to the product of the contrast ratio tolerance C T and the background light level 
B, i.e., P T = C T xB. 

The desired reflectance R^z) of a variable reflectance mirror for each zone is that reflectance level which reduces 
a peak light level P(z) to a value equal to the maximum tolerable peak light level P T , i.e., P T = R d (z) x P(z) or 
55 R d (z) = P T /P(z) , and substituting the expression for P T , R d (z) = (C T x B)/P(z) . However, the maximum tolerable con- 
trast ratio C T varies across the population due to aging and other factors; accordingly, a sensitivity factor S may be used 
to account for this variation in contrast tolerance sensitivity so that R d (z) = (S x C T x B)/P(z) . Selecting the desired 
reflectance R<j(z) for each zone provides maximum information from the rearward scene viewed in each mirror or mirror 
segment while reducing discomforting or disabling peak light levels to tolerable levels. 
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The mirror control signal V c (z) required to obtain the desired reflectance R^z) depends on the particular variable 
reflectance mirror element that is used. For electrochromic mirrors, a voltage-reflectance relationship can be approxi- 
mated and generally defined. In general, an electrochromic mirror has a reflectance level R having a maximum value of 
R 1 with an applied voltage V^ of 0 volts. As the applied voltage V app is increased, the reflectance level R perceptually 
5 remains on the order of until V^p reaches a value of approximately V! . As is further increased, the reflectance 
level R decreases approximately linearly until a minimum reflectance of approximately R 2 is reached at a voltage V 2 . 
Thus, the applied voltage can be approximately defined as: 

v a P p = v i+( R i- R ) x ( V 2- v iV( R i- R 2 ) 

10 

Substituting desired reflectance R^z) for the reflectance R results in the mirror control signal, the voltage of which is 
determined as follows: 

V c (z) = V l+ (R 1 .SxC T xBP(z))x(V 2 -V l )/(Ri-R 2 ). 

15 

To obtain a digital value Vq^z), V c (z) is scaled by a factor that is the ratio of the maximum digital value to the value 
V 2 ; thus, for eight-bit data resolution V DAC (z) = 255 V C (z)/V 2 , and substituting for V C (Z): 

V DAC (z) = 255(V t +(R-|-SxC x x B/P(z))x(V 2 - V ^/(R , - R 2 ))/V 2 . 

20 

Figure 8A provides further detail on the steps S1 50 and S1 60 where the logic circuit 46 determines the background 
and peak light signals. More particularly, steps S151 , S152, S159 and S160 provide two processing loops for sequen- 
tially determining the digital values indicative of the photosensor element signals, Val RA(n,m), in the RAM array 
RA(N,M) for each of the photosensor elements 32a of the photosensor array PA(N.M). 

25 In step S1 53, a lens correction factor LC(n.m) is applied to each digital value indicative of the photosensor element 
signal, Val RA(n,m), to correct for the effects of lens 30, which results in a lens corrected digital value of the photosensor 
element signal Val RALcfn.m). These effects are typically referred to as cosine effects or Lambert's Law effects. The 
lens correction factor LC(n,m) depends on the radial distance of the photosensor element 32a from a central axis of the 
lens 30, and is typically in the range of 1 to 1 5 but will depend on the geometry of the lens and the selected photosensor 

30 array. The lens correction factor LC(n,m) applied to each Val RA(n,m) may be calculated according to Lambert's Law 
each time Val RA(n,m) is processed. More preferably, the logic circuit 46 initially stores an array of values LC(n,m) in 
the RAM 50 for each photosensor element 32a of the photosensor array PA(n,m) during an initialization routine. Alter- 
natively, the size of the photosensor elements 32a of the photosensor array 32 may be adjusted to correct for the lens 
effects at each photosensor element 32a. 

35 As discussed, it has been found that light levels for headlights generally result in an eight-bit digital value greater 
than a peak threshold value F having a value of about 245. Correspondingly, during non-daylight operation of the auto- 
matic rearview mirror system 20, background light levels generally result in eight-bit digital values indicative of the light 
levels incident on the photosensor elements 32a that are less than or equal to the peak threshold value F. 

Accordingly, the lens corrected value Val RA LC (n,m) is compared in step S1 54 to the peak, threshold value F. If Val 

40 RAL^n.m) is less than or equal to F it is used to increment a counter B Count , in the logic circuit 46, by 1 in step S157 
(thereby indicating that a value less than or equal to F has been identified) and by increasing a value B Sum by the value 
of Val RAj_c(n,m) in step S158, where B Sum is the sum of all the values of Val RA LC (n,m) which are less than or equal 
to F. The background light signal Bt is then determined in step S1 61 as follows: B t = B Sum /B . If Val RA LC (n,m) is 
greater than F in step S154, then a the logic circuit 46 uses a counter P(z) indicative of the peak light levels for each of 

45 the zones or sub-arrays S(X) of the photosensor array PA(N.M) is incremented by 1 as previously described. More par- 
ticularly, Val RALc(n f m) is tested in step S155 to determine whether it originates from a particular zone or sub-array 
S(X), where X = 1 to Z . If Val RALc(n,m) does not fall within a defined zone or sub-array S(X), then P(z) is not incre- 
mented; otherwise, P(z) is incremented in step S156 for the appropriate zone. 

If the photosensor array 32 is arranged to view the rearward area through the active layer of the variable reflectance 

so element 1a, then a color correction factor CC is applied in step S162 to B t and P(z) to compensate for any reduction in 
transmittance when the reflectance level (and transmittance) of the rearview mirror 1 is reduced. The value of CC is 
determined from the last calculated value indicative of the digital mirror control signal V DAC (z) applied to the rearview 
mirror 1. In step S163, a change-limited background light signal B Lt is determined as has been described previously. 
Figure 8B provides further detail on step S180 where the logic circuit 46 determines the appropriate digital mirror 

55 control signal V DAC (z) for each zone or sub-array S(X) and corresponding mirror 28. In steps S181 and S182, V DAC (z) 
is calculated for each mirror 28. In step S183, the logic circuit 46 reads a state IN1 of the reverse-inhibit switch 38 and 
if the vehicle is in reverse gear so that IN1 is high, then all digital mirror control signals Vq^z) are set to 0 in step S1 84 
forcing the mirror 28 to its maximum reflectance level. In step S185, a state IN2 of the force-to-day switch 36 is read and 
if IN2 is high, then all digital mirror control signals V DAC (z) are set to 0 in step 186 forcing the mirror 28 to its maximum 
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reflectance level. Finally, in step S187, a state IN3 of the force-to-night switch 40 is read and if IN3 is high, then all digital 
mirror control signals V DAC (z) are set to 255 (the maximum digital value for eight-bit data resolution) in step S1 88 forc- 
ing the mirror 28 to its minimum reflectance level. 

Figure 9 shows another view of the logic flow whereby the rearview mirror, the left side view mirror and the right 

s side view mirror (or alternatively three mirror segments) are independently driven to their desired reflectance levels by 
the independent and separate control and drive signals using photosensor element signals from three photosensor ele- 
ment sets (i.e., the sub-arrays S(1), S(2) and S(3) of photosensor elements 32a in the photosensor array PA(n,m)). The 
specific subroutines shown in Figs. 8A and 8B corresponding to the general steps shown in Fig. 7 are also used with 
the general steps shown in Fig. 9. 

w In step S201 , light incident on the lens 30 is focused in step S210 onto the photosensor array 32 comprising the 
first, second and third sets of photosensor elements 32a in zones a, b and c, respectively. Next, in step S21 1 , the light 
incident on the first photosensor element set in zone a generates a first set of photosensor element signals, which, in 
step S21 V, are then stored in RAM and later used by the logic circuit 46 to determine a first peak light signal in step 
S212. 

is In step S221 , the light incident on the second photosensor element set in zone b generates a second set of photo- 
sensor element signals, while in step S231 , the light incident on the third photosensor element set in zone c generates 
a third set of photosensor element signals. The second set of photosensor element signals, generated in step S221 are 
also stored in step 22 V in RAM and then used by the logic circuit 46 to determine a second peak light signal in step 
S222. Similarly, the third set of photosensor element signals, generated in step S231, is next stored in step S231' in 

20 RAM and then used by the logic circuit 46 to determine a third peak light signal in step S232. 

In step S213, photosensor element signals generated from selected photosensor elements on which light is inci- 
dent in step S210 are used to determine the background light signal. 

In step S214. the logic circuit 46 uses the background light signal determined in step S213 and the first peak light 
signal determined in step S21 2 to determine a first control signal. Similarly, the logic circuit 46 uses the background light 

25 signal of step S213 and the second peak light signal determined in step S222 to determine a second control signal in 
step S224. In the same manner, the background light signal of step $213 and the third peak light signal of step S232 
are used by the logic circuit 46 to determine a third control signal in step S234. 

The first control signal determined in step S214 is used by the drive circuit 24a to generate a first drive signal in 
step S215. This first drive signal drives the rearview mirror 28a to a desired reflectance level in step S216. Likewise, the 

30 second control signal determined by the logic circuit 46 in step S224 is used by the drive circuit 24b to generate a sec- 
ond drive signal in step S225, which is then used to drive the left side view mirror 28b to a desired reflectance level in 
step S226. Finally, the third control signal determined by the logic circuit 46 in step S234 is used by the drive circuit 24c 
to generate a third drive signal to drive the right side view mirror 28c to a desired reflectance level in step S236. Of 
course, the first, second and third control signals may also be used to control the segments of a mirror 28. 

35 Finally, as previously discussed, one advantage of the present invention is that it is able to use a single photosensor 
array 32 to determine both a background light level and a peak light level for controlling the reflectance level of a mirror. 
This is especially advantageous where the sensor must be placed outside the interior of the vehicle to view the rearward 
scene. This may be required, for example, in certain truck type vehicles where only exterior side view mirrors may be 
used and automatic operation is desired. Accordingly, the photosensor array 32 may be located with each side view mir- 

40 ror. The other electronics for the automatic rearview mirror system 20, described previously, may be located either with 
the photosensor array 32 in each side view mirror, inside the vehicle cab or elsewhere in or on the vehicle. A desired 
reflectance level for each exterior side view mirror may then be accurately determined using both the determined back- 
ground light level and peak light level using only a single photosensor array 32 for each mirror. 

Figures 12 and 12A show the logic flow charts of the vehicle interior monitoring system configured as a vehicle 

45 intrusion detection system (primary task S400). 

In step S401, the current image data frame RA^ is processed to enhance its contrast characteristics so that it is 
largely unaffected by changing light levels or shadows, etc. Preferably, the logic circuit 46 selects an appropriate sub- 
array RS( t ) corresponding to the sub-array S(X) (or other appropriate set) of photosensor elements 32a of the photo- 
sensor array 32 containing the relevant image information. 

so As discussed, the particular area of interest or significance in the photosensor array 32 may be a sub-array S(X) of 
photosensor elements 32a of the photosensor array 32 (or other appropriate set not necessarily rectangular in shape, 
such as a trapezoid). The ability to select image data corresponding to S(X) is important because some sets of photo- 
sensor elements 32a may provide image information that is redundant, irrelevant or even damaging to a particular appli- 
cation and should therefore be ignored by the logic circuit 46. A significant advantage of the photosensor array 32 over 

55 other sensing technologies is its ability to provide selected image information so that the logic circuit 46 need only proc- 
ess RS( t ) when for example, the relevant sub-array S(X) and corresponding sub-array RS (t) contain all the image infor- 
mation necessary to a particular application. For example, in the automatic rearview mirror and vehicle intrusion 
detection system described herein, a selected sub-array S(X) of photosensor elements 32a may provide image infor- 
mation as shown in Figs. 3A and 3B, which may be used by logic circuit 46 to provide information regarding the location 
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and intensity of the headlights of following vehicles. To the extent that other areas of the photosensor array 32 do not 
provide such image information, they may be ignored. Likewise, since the same photosensor array 32 may be used for 
vehicle intrusion detection, the logic circuit 46 need only process the image information of Fig. 2A that excludes the 
image information of Figs. 3A and 3B. Without this ability to select particular sets or sub-arrays, at least more intensive 
5 processing may be required to distinguish between unauthorized activity within the vehicle and irrelevant activity out- 
side the vehicle. 

After selecting the appropriate set of image data, the logic circuit 46 processes the values in RA( t) to enhance the 
contrast or robustness of that image data frame. Excluding photosensor elements 32a in the outside rows and columns 
of the photosensor array 32, every photosensor element E(n,m) has eight (8) adjacent photosensor elements 32a or 

10 neighbors: E(n-1,m); E(n,m-1); E(n-1,m-1); E(n+1,m); E(n,m+1); E(n+1,m-1); E(n-1,m+1); and E(n+1,m+1). Therefore, 
a contour value CV(n,m) for each photosensor element E(n,m) may be calculated by determining the average of the dif- 
ferences between the value Val RA LC (n,m) of the photosensor element E(n,m) and the value of each neighbor. If the 
photosensor element value is an n-bit value, then CV(n,m) is also an n-bit value. Thus, using 8-bit data resolution, for 
example, if E(n,m) has a 0 value and each neighbor has a value of 255, then CV(n,m) is 255. If E(n,m) has a value of 

is 255 and each neighbor has a 0 value, then CV(n.m) is 255. Both examples indicate a high degree of local contrast or 
discontinuity. On the other hand, if E(n,m) and each neighbor has a value of 127, then CV(n,m) is 0, which indicates a 
low degree of local contrast. Thus, the logic circuit 46 uses the above method, to determine the contrast value CV(n.m) 
for each value Val RA^am) of RA^ t) to obtain a contour enhanced image data frame RC( t ) in which the "harder" image 
contours or discontinuities are emphasized or enhanced, while "softer" image contours are reduced in significance. 

20 Next, in step S402, the logic circuit 46 correlates the current image data frame RC (t) and a reference image data 
frame RCrep^j by comparing them to determine an image correlation factor IC. This factor is indicative of the corre- 
lation or degree of similarity (or difference) between the two image data frames independent of the particular image or 
photosensor array size. An IC value of 0 indicates no image similarity and an IC value of 1 indicates a perfect match. In 
particular, the image correlation factor IC is indicative of the number of corresponding photosensor elements 32a within 

25 the photosensor array 32 (or sub-array S(X)) having the same value Val RALc(n,m) within some tolerance value T for 
the current and reference image data frames or sets. The tolerance value T accounts for minor image variations, such 
as may be caused by system vibration or other system "noise". Thus, the value from the current image data frame RC( t ) 
corresponding to photosensor element E(1 ,1) is compared with the value from the reference image data frame RC REF ( t . 
corresponding to photosensor element E(1,1), and if: 

30 

Val RC (t) (1,l) = ValRC REF(M) (1,1)±T, 

then the RC^ and RC REF (M) values of photosensor element E(1 , 1 ) correlate. This is done for all photosensor elements 
32a within the photosensor array 32 or selected sub-set thereof, and the logic circuit 46 stores and sums each correla- 

35 tion occurrence for each element E(n,m). The logic circuit 46 then divides the resulting sum of correlation occurrences 
by the number of elements E(n,m) considered in determining the image correlation factor IC. 

Next, in step S403, the logic circuit 46 determines whether certain system start-up criteria are met. This is done to 
ensure that a stable image data frame RC (t) is stored as RC REF(t) . Importantly, RC REF(t) must correspond to an opti- 
mized and stable image data frame RC (t) . When power is initially supplied to light sensing and logic circuit 26, electrical 

40 and thermal transients occur as is typical for silicon integrated circuits. For the system described herein, satisfactory 
start-up criteria include: (1) a minimum number of image data frames that must be processed to allow electrical stabili- 
zation and the completion of the majority of EP and SSI optimization, where the minimum number of data frames is pref- 
erably 25 but may be in the range of 15 to 40; and (2) a stable reference image RC REF ( t ), where RC REF(t ) is sufficiently 
stable when AR is within the operating point range OP ± R and IC exceeds 0.95 for at least 2 to 1 0 image data frames, 

45 but preferably 4 image data frames. 

If the start-up criteria are not met in step S403, then, in step S404, the logic circuit 46 stores RC( t) in RAM 50 as a 
reference image data frame RC REF(t ) (which is RC REF (M) where the current image data frame is RC^on the next sys- 
tem cycle) and the program returns to step S31 0. If the start-up criteria in step S403 are met, then the program goes to 
step S405. 

so In steps S405 and S406, threshold values T 1 and T 2 are used to determine the degree to which the current and 
reference image data frames match or mismatch. The values of T 1 and T 2 depend on the particular application and the 
degree of confidence or reliability required in the match/mismatch conditions of steps S405 and S406. For the vehicle 
intrusion detection system, it has been found that appropriate threshold values may range from 0.0 to 0.6 for Ty and 
from 0.95 to 1.0 for T 2 , but are preferably 0.6 and 0.95 for ^ and T 2> respectively. Due to image or system variations, 

55 perfect image correlation does not normally occur; therefore, compared image data frames having an IC value greater 
than 0.95 are considered a match, those having an IC value less than 0.6 are considered a mismatch and those having 
an IC between T 1 and T 2 are neither a definite match nor a definite mismatch. 

More particularly, if IC exceeds T<\ in step S405, then the logic circuit 46 determines whether IC exceeds T 2 in step 
S406. If IC does not exceed T 2 , then the program returns to step S310 since there is neither a match nor a mismatch 
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condition. If IC does exceed T 2 , then there is a match and the logic circuit 46 updates the reference image data frame 
RC RE F(t)- It should be understood that RC REF(t) may be the same as RC (t) or may represent any appropriate combina- 
tion of two or more image data frames. For example, RC RE F(t) m ay be determined using a digital lag filter: 

5 R C REF(t) = R C REF(M) + K X ( R ^ (1) " R ^ REF(M))» 

where K may be a constant. After the logic circuit 46 updates RC REF(t ) and stores it in the RAM 50, the program again 
returns to step S3 10. 

If IC does not exceed T t in step S405, then the image data frames are considered a mismatch. Even though T 1 is 

10 selected so that only significant differences between RC( t ) and RC RE f(M) provide a mismatch condition, the logic circuit 
46 determines in step S408 whether the mismatch condition is valid intrusion condition. This is because there are con- 
ditions that result in the logic circuit 46 erroneously determining a mismatch condition. For example, automotive electri- 
cal system noise may affect the ability of the photosensor array 32 to provide accurate photosensor element signals, 
although this normally occurs only for short periods given the nature of such noise. While not all system applications 

is may require the same level of confidence for a correct mismatch condition, it has been found that requiring a number of 
successive mismatch conditions represents a good validation test for step S408. In particular, it has been found that this 
validation test better ensures that the mismatch condition is valid by requiring from 2 to 300 successive mismatch con- 
ditions. Alternatively, the validation test may require from 2 to 300 initial mismatch conditions and allow a number of 
match conditions in step S405, where the number of match conditions may be from 1 to 15 depending on the required 

20 number of mismatch conditions. 

If the logic circuit 46 determines that the mismatch condition is not valid in steps 408, then the program will go to 
step S310. If the mismatch condition is valid, then the logic circuit 46 outputs one or more control signals in step S409. 
The control output signals are generally of two types: (1) signals that may be used to control directly certain vehicle 
hardware (lights, horn, etc.); and (2) signals that may be used as inputs to other vehicle controller systems that directly 

25 interface with such hardware. The logic circuit 46 may output any combination of these control output signals depending 
on the desired level of integration between the system of the present invention and other vehicle systems. Digital control 
signals, such as bistable signals or digitally coded words interpreted by other vehicle systems, are topical for most appli- 
cations. If the logic circuit 46 outputs bi-stable control signals directly to vehicle hardware, then the control output signal 
lines may be latched in a high or low state to control the vehicle hardware. If the logic circuit 46 outputs control signals 

30 to a vehicle controller system, then a higher protocol level, (such as digitally coded words) may have to be output from 
the logic circuit 46. 

Figure 12B shows the logic flow chart of the compartment image data storage system configuration (primary task 
routine S500) of the vehicle interior monitoring systems of Fig. 12. 

In step S501 , the image data frame RA (t) (although this may be RC (t )) is tested to determine whether it is valid. To 

35 determine whether RA {t) is valid in step S501 , the logic circuit 46 may determine whether the array response AR is 
within the operating point range OP ± R. More stringent validity tests may include vehicle feature recognition, in which 
the system attempts to identify reference vehicle features, such as the seats or window pillars, and if the logic circuit 46 
cannot identify these reference features in RA^ t j, then it determines that RA (t) is invalid. If RA^ is valid, then RA^ may 
be optionally compressed in step S502 using any appropriate digital compression method to reduce the amount of 

40 image data. Next, in step S503, the logic circuit 46 stores the image data in the nonvolatile memory 57 on a first-in-first- 
out (FIFO) basis. As will be described further below, the program may end or return to step S310 to obtain and process 
additional image data frames depending on the particular application. If RA {t) is not valid, then in steps S504, S505, 
S506 and S507, the logic circuit 46 determines whether the photosensor 2 has been intentionally defeated so that an 
accurate image data frame of the vehicle interior or compartment cannot be generated and stored in the nonvolatile 

45 memory 57. 

More particularly, in steps S504 and S506, if it is determined that both EP and SSI are minimums, then the photo- 
sensor 2 is probably being defeated by an intruder or vehicle thief who is blinding the photosensor 2 by directing a light 
source, such as a bright flashlight, directly at the photosensor 2. This action saturates the photosensor array 32 so that 
the image data frame appears "white". Since the photosensor array 32 normally does not saturate when both EP and 

so SSI are at their minimums, a "white" image data frame would not normally occur. In steps S505 and S507, if it is deter- 
mined that both EP and SSI are maximums, then the photosensor 2 is probably being defeated by an intruder who is 
blinding the photosensor by placing a piece of tape or other opaque material over the lens 30 (or window) which the 
photosensor array 32 uses for "seeing" the vehicle interior 100. This action results in a "black" image data frame. Since 
SSI is maximized to allow the photosensor array 32 to generate images even if there is insufficient natural light, a "black" 

55 image data frame would also not normally occur. 

If steps S504, S505 and S507 result in a "black" image condition or steps S504 and S505 result in a "white" image 
condition, then the logic circuit 46 outputs a control signal in step S508 to the vehicle controller to disable the ignition 
control device and/or to the vehicle controller system to activate the horn and lights. Otherwise, EP and SSI have not 
reached their adjustment limits, and the system attempts to optimize them and generates another image data frame 
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which is then again tested to determine its validity in step S501. 

VI. Integrated Headlight Control System 

5 It is generally important for driver safety reasons that the headlights and sidelights of operating vehicles are turned 
on as night approaches or when background lighting levels fall below approximately 500 lux. More particularly, it is 
desirable to have the vehicle's headlights and sidelights automatically turn on when background lighting levels fail to a 
sufficiently low level and automatically turn off when background lighting levels rise sufficiently. 

While there are other automatic headlight control systems, such systems require that the photocells, which are 

10 used to control the headlights, be located and positioned so that they generally face upward either to avoid the effects 
of oncoming headlights for generally forward facing photocells or to avoid the effects of following headlights for generally 
rearward facing photocells. 

An advantage of the automatic rearview mirror system 20 is that the background light signal B Lt may be used to 
automatically turn on and off a vehicle's headlights and sidelights by controlling the vehicle lighting switch 45. Impor- 
ts tantly, since B Lt is determined regardless of the presence of peak light sources, such as oncoming or following head- 
lights, the directional constraints on how and where the sensor is located or positioned are avoided. Accordingly, using 
the photosensor array 32 of the present invention to provide additional vehicle lighting control functions results in lower 
costs and improved reliability over other headlight control systems. 

The limited background light signal B Lt has been described for the purpose of controlling the reflectance levels of 
20 an automatic rearview mirror system 20. Additionally, the logic circuit 46 may use B Lt to generate a vehicle lighting con- 
trol signal to control the vehicle lighting switch 45 to turn on and off automatically the vehicle's headlights and sidelights. 
The ability to use B Lt is important because the vehicle lighting switch 45 should not be responsive to rapid or small fluc- 
tuations in background light levels in the region of the desired point at which the vehicle lighting switch is turned on or 
off, i.e., the switch point. Such fluctuations can be caused by the shadowing effect of overhanging trees or structures or 
25 the lighting differences between the eastern and western skylines at dawn and dusk which may be encountered when 
turning the vehicle. 

Additionally, hysteresis is also provided between the switch-on and switch-off conditions of the vehicle lighting 
switch 45 to further stabilize operation of the switch 45 in such fluctuating light conditions. More specifically, if the 
required switch point for falling light levels is SP, then the switch point for rising light levels is SP x (1 + H) , where H is 

30 a hysteresis factor typically in the range of about 0.005 to 0.5, but is preferably 0.2. Thus, rf B Lt is less than SP, then the 
vehicle lighting control signal to the vehicle lighting switch 45 is set high to turn on the vehicle's headlights and side- 
lights. If B Lt is greater than SP x (1 + H) , then the vehicle lighting control signal to the vehicle lighting switch 45 is set 
low to turn off the vehicle's headlights and sidelights. 

Additionally, if the photosensor array 32 and logic circuit 46 are both-powered directly by the vehicle's electrical sys- 

35 tern through the ignition switch, then a time delay td may be provided such that if the ignition switch is turned off when 
the headlight control signal is set high, the vehicle lighting control signal will remain high for a time ^ and thereafter fall 
to a low value to turn off the vehicle's headlights and sidelights. A manual control may also be provided to allow the 
driver to adjust the time delay td- 

Finally, the vehicle lighting control signal and, more specifically, the lighting control switch 45 may also be used to 

40 inhibit automatic control of the automatic rearview mirror system 20. For example, if the vehicle lighting control signal 
indicates that the vehicle lighting should be turned off, then the logic and control circuit 34 may be used to enable sen- 
sitivity switch 42 or some other switch allowing the driver to manually adjust the reflectance level of the mirrors 28. Thus, 
the driver may manually select a lower reflectance level during daylight conditions to provide protection against peak 
light sources, such as a bright setting sun. As background light levels fall or during non-daylight conditions, the vehicle 

45 lighting control signal would indicate non-daylight conditions and the logic and control circuit 34 may then be used to 
disable manual control and return the automatic rearview mirror system 20 to full automatic control. 

VII. The Automatic Rearview Mirror And Vehicle Interior Monitoring System 

so Figure 10 also shows the automatic rearview mirror system 20 of the present invention. The system 20 is powered 
by the vehicle's electrical system (not shown) to which the system 20 is connected. A voltage regulation and transient 
protection circuit 22 regulates power and protects the system 20 from voltage transients as is well known in the art. The 
circuit 22 is connected to the vehicle's electrical system and to ground, and outputs a voltage of up to about 5 volts to 
power the mirror drive circuits 24 and the light sensing and logic circuit 26. The circuit 22 also has a ground line con- 

55 nected to the light sensing and logic circuit 26. 

The 5 volt line is also connected to the force-to-day switch 36 and the reverse-inhibit switch 38 (connected in par- 
allel to the light sensing and logic circuit 26) which are used to force the mirrors 28 to their maximum reflectance level. 
More particularly, when either of these switches is closed, they generate a high level signal V H such as a 3 volt signal, 
which is input to the light sensing and logic circuit 26. This high level signal overrides the normal operation of the light 
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sensing and logic circuit 26 causing it to output a control signal to the drive circuits 24 to drive the mirrors 28 to their 
maximum reflectance level. Conversely, when these switches are open, they each generate a low level signal V L such 
as a signal of less than 3 volts, thereby permitting normal operation of the light sensing and logic circuit 26, as has been 
discussed with respect to Figs. 7, 8A and 8B. The force-to-day switch 36 and the reverse-inhibit switch 38 may be alter- 

5 natively configured to generate a low level signal when closed and a high level signal when open. The force-to-day 
switch 36 is a manually operated switch and is preferably placed on the rearview mirror 28a and may be switch 3. The 
reverse-inhibit switch 38 is connected to a reverse inhibit line in the vehicle's electrical system (not shown) so that the 
reverse-inhibit switch 38 is actuated automatically whenever the vehicle is in reverse gear. 

The force-to-night switch 40, used to force the mirrors 28 to their minimum reflectance level, generates a high level 

io signal V H when closed and a low level signal V L when opened. The signal V H or V L is then input to the light sensing and 
logic circuit 26. The high level signal may, for example, be between 3 to 5 volts and the low level signal may be below 3 
volts. The high level signal overrides the normal operation of the light sensing and logic circuit 26, as discussed with 
respect to Figs. 7, 8A and 8B, causing the circuit 26 to output a control signal to the drive circuits 24 to drive the mirrors 
28 to their minimum reflectance level. The low level signal, on the other hand, permits normal operation of the light 

15 sensing and logic circuit 26. Alternatively, the force-to-night switch 40 may be configured to generate a low level signal 
when closed and a high level signal when open. The force-to-night switch 40 is also a manually operable switch, pref- 
erably located on the rearview mirror 28a. and may also be switch 3. 

The light sensing and logic circuit 26 is also connected to the sensitivity control circuit 42. The circuit 42 enables 
the operator to manually adjust the sensitivity of the mirrors 28 using the switch 3 (shown in Figs. 1 A and 1 B). The sen- 

20 sitivity control circuit 42 (switch 3) may comprise a potentiometer whose voltage may be varied from zero to five volts. 
Alternatively, a single resistor may be used to provide a single preset sensitivity setting that cannot be changed by the 
driver. 

As previously discussed with respect to Figs. 5 and 6, the light sensing and logic circuit 26 comprises the photo- 
sensor array 32 (or other light sensing device) and the logic and control circuit 34. These two devices may be either sep- 
25 arate or commonly located on a single semiconductor substrate. The light sensing and logic circuit 26 is preferably a 
single VLSI CMOS circuit 

Also shown in Fig. 10, the light sensing and logic circuit 26 outputs analog mirror control signals having voltages 
varying from zero to approximately 5 volts to the mirror drive circuits 24 and a vehicle lighting control signal of 0 to 5 
volts to the vehicle lighting switch 45. Alternatively, as previously discussed the light sensing and logic circuit 26 may 

30 output a 5 volt pulse-width-modulated (PWM) signal to the mirror drive circuits 24. The mirror drive circuits 24 then gen- 
erate and apply drive voltages varying from a low voltage on the order of 0 volts to a high voltage on the order of 1 volt 
to drive the mirrors 28. The actual driving voltage (or current) may, of course, be significantly lower or higher depending 
on the variable reflectance mirror element 1a used. 

Each of the mirrors 28 preferably comprises a reflective electrochromic (EC) cell whose reflectance level may be 

35 varied from a maximum of anywhere from approximately 50 to 90 percent to a minimum of approximately 4 to 15 per- 
cent, and having a maximum driving voltage on the order of about 1 to 2 volts. As is well known in the art, electrochromic 
devices change their reflectance level when a voltage or other appropriate drive signal is applied to the electrochromic 
device. The mirrors 28 alternatively may comprise any other suitable variable reflectance mirror. 

As previously discussed, it is also within the scope of the present invention for the light sensing and logic circuit 26 

40 to be located remotely from the mirrors 28 of the system 20. However, it is preferred that the light sensing and logic cir- 
cuit 26 be integral with the rearview mirror 28a such that: (1 ) the center line of the field of view of the photosensor array 
32 is substantially perpendicular to the reflective surface of the rearview mirror 28a; and (2) the horizontal field of view 
of the photosensor array 32 is aligned with the horizontal axis of the rearview mirror 28a. As a result, the photosensor 
array 32 receives the light that will be incident on the rearview mirror 28a as shown in Fig. 6. 

45 As has been discussed, the automatic rearview mirror system containing the photosensor array 32 may be 
extended to include a vehicle interior monitoring system configured as a vehicle intrusion detection system by vertically 
extending the effective field of view of the photosensor array 32 and by providing vehicle intrusion detection logic in the 
logic circuit 26. Importantly, the automotive rearview mirror and vehicle interior monitoring systems do not have to func- 
tion simultaneously in both the vehicle intrusion detection mode and automatic rearview mirror mode. Therefore, the 

so operation of the vehicle intrusion detection mode may be described independently of the operation of the automatic 
rearview mirror mode. As is described further below, a switch is used to input a mode select signal to the logic circuit 
46 to select the desired operating mode. 

In the vehicle intrusion detection mode, those photosensor elements 32a corresponding to the image segment 
below the lower edge of the vehicle window areas (i.e., the image information of Fig. 2A excluding the image information 

55 Figs. 3A and 3B) are considered significant. Each photosensor element 32a is associated with a small and unique por- 
tion of the imaged scene. In particular, each photosensor element 32a senses light within its own image cone. For the 
preferred photosensor array 32, each photosensor element 32a is responsive to an area approximately one (1) inch 
square at 100 inches, which is about the maximum distance from the photosensor array 32 mounted in the rearview 
mirror 1 to most vehicle cabin interior surfaces within the area of interest. For the photosensor array 32 described 
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above, one set of about 6,400 (1 60 x 40 sub-array) photosensor elements 32a are used in the automatic rearview mirror 
mode and another set of about 12,800 (160 x 80 sub-array) photosensor elements 32a are used in the vehicle intrusion 
detection mode. The ability of the photosensor array 32a to resolve the area of interest into a number of data values 
and to select particular image information, while ignoring other image information, is significant and distinguishes this 

s vehicle intrusion detection system from other vehicle intrusion detection systems and technologies. 

The automatic rearview mirror and vehicle interior monitoring system as shown in the schematic block diagram of 
Figure 10A is identical to the automatic rearview mirror system shown in the schematic block diagram of Figure 10 
except as follows. First, as explained above, the array size required for an independent automatic rearview mirror sys- 
tem must be expanded from 160 x 40 to 160 x 120 to provide a larger effective field of view that includes most of the 

w vehicle interior 100. Second, additional logic or control circuitry is incorporated in logic circuit 46 to process the vehicle 
intrusion detection logic of Figs. 12 and 12A. The light sensing and logic circuit 26 includes additional control input lines 
for the "arming" and "alerting" control input signals and control output lines to interface with vehicle hardware or vehicle 
controller systems. Finally, the regulation and transient protection circuit 22 also has an additional vehicle power supply 
line (12V BATTERY), and a switch or other logic for providing a mode select signal that is input to the light sensing and 

is logic circuit 26. 

Normally, power is provided to vehicle hardware through the ignition switch controlled power supply circuits to avoid 
battery drain. Since the automatic rearview mirror system operates when the vehicle is being driven, it is normally con- 
nected to an ignition switch controlled power supply circuit as shown in Fig. 10. Since the vehicle intrusion detection 
system operates when the ignition switch is off, the regulation and transient protection 22 includes the additional vehicle 

20 battery power supply line for supplying power directly from the vehicle battery. The regulation and transient protection 
circuit 22 also includes a switch or other logic circuit (not shown) to output a mode select signal to the light sensing and 
logic circuit 26. The mode select signal is low (0 volts) when power is not available through the ignition switch controlled 
power supply circuit and high (5 volts) when it is. 

The light sensing and logic circuit 26 includes an input line to receive an "arming" input signal 49a to actively arm 

25 the vehicle intrusion detection system. 

Although not shown in Fig. 10A, other vehicle systems are typically used to supply an "arming" input signal. Such 
systems may be actuated by using conventional infrared or RF type remote control or by the activation of central door 
locking systems using the door key or entry combination keypad. 

The light sensing and logic circuit 26 also includes input lines to receive an "alert" input signal(s) 49b to increase 

30 the sampling rate, such as when a trunk lid opening has been detected and increased monitoring may be required. The 
light sensing and logic circuit 26 also includes one or more output signal lines to the vehicle hardware 45a and/or to the 
vehicle controller system 48, for activating the horn and lights or disabling the ignition control device. The control output 
signal is normally low (0 volts) and goes high (5 volts) when there is an intrusion condition, but may also be a data word 
providing more detailed information, (such as the location of the intrusion) to the vehicle controller system. 

35 When power is supplied to the automatic rearview mirror system through the ignition switch controlled power supply 
circuit, the regulation and transient protection circuit 22 outputs a high (5 volts) mode select signal to the logic circuit 
46. This causes it to select the automatic rearview mirror mode and the system functions as an automatic rearview mir- 
ror system as previously described. 

When the ignition switch is turned off, the mode select signal goes low (0 volts) and the logic circuit 46 sets the sys- 

40 tern to a low power mode, in which the logic circuit 46 only monitors the status of the mode select and "arming" control 
input signals. In this state, the vehicle intrusion detection mode is available, but the system is not "armed" and it is not 
monitoring the vehicle cabin. When in this state and when the "arming" control input signal is active, then the logic cir- 
cuit 46 enters the vehicle intrusion detection mode described with respect to Figs. 12 and 12A. 

As previously described, in step S301 , the logic circuit 46 initializes the system (e.g., resets the counters, etc., used 

45 in the automatic rearview mirror mode) and sets EP to its maximum value and SSI to its minimum level. Since the light- 
ing levels are not known and may be at any level within the full operating range of the system at the time of arming, the 
system must determine the optimum combination of EP and SSI by maximizing the number of photosensor elements 
32a providing useful image data. To minimize system power consumption, the method is biased to minimize SSI and 
maximize ER In step S310, the status of the mode select, "arming" and "alerting" signals is monitored to confirm the 

so appropriate operating mode. For example, if the "arming" signal goes inactive, then the system returns to a disarmed, 
low power mode and only monitors the mode select and "arming" signals. If there is no status change, then the system 
generates and stores RA W (using steps S101 to S140 of Fig. 7). The logic circuit 46 ignores RAM array data corre- 
sponding to the 160 x 40 array of photosensor elements 32a generally associated with the window areas as shown in 
Figs. 3A and 3B, and processes the RAM array data corresponding to the 160 x 80 array of photosensor elements 32a 

55 generally associated with the vehicle cabin interior generally excluding the window areas of Figs. 3A and 3B. It should 
be understood that a trapezoidal sub-set of RAM array data, corresponding to the same sub-set of photosensor ele- 
ments 32a, may be selected so as to better correspond to the vehicle cabin interior excluding the window areas. 

In step S320, the logic circuit 46 determines AR by calculating the average value of all the values in the selected 
sub-set of RAM array data. In the system described, AR may be in they range 0 to 255 (8-bit data resolution), but it is 
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preferably at the operating point OP of 127 (mid-point of the range); however, for system stability purposes the range 
factor R results in an operating point OP range of 127 ± 20. In step S330 and $360, it is determined whether AR is in 
the range OP ± R. If AR is outside the range, then EP and SSI are incrementally increased or decreased according to 
steps S341 , S342 or S351 , S352. This is repeated for every image data frame. The system thus optimizes EP and SSI 
5 for the particular circumstances at system startup, and thereafter continues to adjust EP and SSI to maintain AR within 
the range OP ± R as lighting conditions change. If AR is within the range, then the program enters the primary task 
S400 in block S370. 

The vehicle intrusion detection system is designed to be responsive or sensitive to movement or motion within the 
vehicle interior 100 and insensitive to changes in general lighting conditions, moving shadows, etc. The system does 

10 this by reducing every image data frame to its robust and unique characteristics, largely unaffected by random light 
sources or changes in general lighting conditions. After sufficient image data frames have been processed to allow 
electrical stabilization and optimization of EP and SSI, the contour enhanced image data frame RC( t) is stored as the 
reference image data frame. Every image data frame is processed in the same way as the reference image and is then 
compared to the reference image. Decisions are reached after several images have been compared producing the 

is same result Three conclusions are possible after comparing images in the manner described. Images may be essen- 
tially the same, significantly different or neither similar enough nor different enough to make a decision. If this first con- 
dition exists for long enough, changes to the reference image are considered. Confirmation of the differences over 
several images result in a concluded intrusion. 

More particularly, in step S401 , the logic circuit 46 converts RA (t) to its contour enhanced form RC (t ) by calculating 

20 the average difference between the value of RA^ for each element E(n,m) and each of its eight (8) neighbors. As dis- 
cussed, at system start-up, the system must electrically stabilize and must also adjust EP and SSI to optimize the image 
data frame stored as RC REF ( t ). This is done by cycling at least several times from step S310 through steps S403 and 
S404 and then returning to step S310. In step S404, the image data frame RC (t) is stored in RAM 50 as RC REF ( t ) so 
that RC( t ) and RCref^) are available in step S402 in RAM 50 for comparison. In step S402, the correlation factor IC 

25 for RC( t ) and RC REF ( t .«|) is determined. During this start-up period, EP and SSI become stable. 

In step S403, the start-up criteria are tested, as previously described, and if the count is greater than 25 and the 
images RCq and RC REF (M) correlate (IC exceeds 0.95), then the system continues through step S405. Otherwise, it 
continues through step S404 until the image is stable. In the normal monitoring mode, IC is tested against ^ in step 
S405, where is 0.6 (T , may be less than 0.6). If the degree of correlation or correspondence between the current 

30 and reference image data frames is poor (IC is less than 0.6), then the image data frames are judged to be sufficiently 
different to suggest that vehicle intrusion has occurred. Vehicle intrusion detection systems arc evaluated on their ability 
to detect intrusion conditions and to avoid false intrusion conditions. To avoid false intrusion conditions, in step S408, 
the number of successive mismatch conditions is counted and compared to a preset value of 20 (which may be in the 
range 2 to 300), and a valid intrusion detection condition is established in step S408 after 20 successive mismatch con- 

35 ditions. In step S409, the logic circuit 46 outputs control signals to vehicle hardware 45a or to the vehicle controller sys- 
tem 48 for further processing, which may result in an alarm sounding, vehicle immobilization or other appropriate action. 
The system continues to monitor the vehicle interior or compartment by returning to step S310. If the number of suc- 
cessive mismatch conditions falls below 20 in step S408, then the system returns to step S310. 

In step S405, if IC is greater than 0.6, then the images are not sufficiently different to confirm an intrusion condition. 

40 It is desirable to update the reference image data frame RC REF (t) if changes occur due to minor and slowly changing 
conditions outside the vehicle, such as changing light levels or slowly moving shadows due to the sun tracking across 
the sky. Accordingly, in step S406, IC is compared to T 2 (where T 2 is 0.95 but may be in the range 0.95 to 1), and if IC 
exceeds T 2 , then the logic circuit 46 updates and stores the reference image data frame RC REF ( t ) in step S407. The 
logic circuit 46 may replace RC REF(M j with RC (t) or modify RCp,^.^ as previously described. The system continues 

45 to monitor the vehicle interior by returning to step S310 until the "arming" control input signal goes inactive. 

It should be understood that the larger field of view provided by the 1 60 x 1 20 array of the vehicle intrusion detection 
system enables further analysis of the rearward scene. Specifically, the background light signal B, may be determined 
using a larger set of photosensor array elements 32a. The combination of the automatic rearview mirror detection sys- 
tem and vehicle intrusion detection system additionally provides an opportunity for using SSI to illuminate the vehicle 

so interior under dark conditions for the purpose of precise identification of specific vehicle features such as those indi- 
cated in Fig. 2A. 

Vehicle feature identification is useful in the automatic rearview mirror system because it allows the logic circuit 46 
to select each of the sub-arrays S(X) of photosensor elements 32a corresponding to zones a, b and c indicated in Figs. 
3A and 3B. This is useful when the photosensor array 32 is positioned in the rearview mirror 1 . Active adjustment allows 
55 the logic circuit 46 to select sets or sub-arrays S(X) of photosensor elements 32a such that zones a. b and c are indic- 
ative of identical vehicle regions independently of driver rearview mirror 1 adjustment. 

Finally, to minimize battery power drain, the system described may be operated in a low power mode by reducing 
sampling rate at which images are obtained and processed, such as one image data frame per second. However, if the 
logic circuit 46 receives an "alerting" control input signal such as may be received from a vibration, motion, trunk lid or 
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door opening sensor, then the system described herein may return to its normal sampling rate. Alternatively, this may 
also be achieved by having the system use the lower sampling rate until the logic circuit 46 establishes a poor image 
correlation (i.e., IC < 0.6) in step S406 and selects the higher sampling rate. 

The vehicle interior monitoring system may also be configured as a compartment image data storage system to 

5 store any compartment image, such as the driver image, in the nonvolatile memory 57. The automatic rearview mirror 
and vehicle interior monitoring system configured as a compartment image data storage system is shown in the sche- 
matic block diagram of Fig. 1 0A and the previous description of Figs. 1 0 and 1 0A applies except as follows. First, in the 
specific embodiment described herein, the light sensing and logic circuit 26 does not use control input lines for receiving 
the "arming" control input signal 49a and the "alerting" control input signal (s) 49b as in the vehicle intrusion detection 

w system. Second, the additional vehicle power supply line (1 2 V BATTERY) and mode select signal line are also not used 
in the specific embodiment described herein. This is because the compartment image data storage system may be lim- 
ited to operating when the vehicle has been started since both authorized and unauthorized drivers actuate the ignition 
switch to start the vehicle (the vehicle thief may, of course, break the steering column ignition lock system to do this). 
Thus, power is always supplied through the ignition switch controlled power supply (12V IGNITION) when the vehicle is 

is started. Finally, the light sensing and logic circuit 26 includes input/output lines to interface with the nonvolatile mem- 
ory/data access logic and port 65, which comprises the nonvolatile memory 57, access/security decoding logic 58 cir- 
cuit and data access part 59 of Fig. 6A. To reduce data storage requirements, the image data frame may be 
compressed using any appropriate digital image compression technique as discussed with respect to Fig. 6A. The 
image data frame is then stored in the nonvolatile memory 57, such as an EEPROM or any other appropriate nonvola- 

20 tile memory, which has sufficient storage to store a predetermined number of image data frames. 

The compartment image data storage system may be configured to store a single image data frame in the nonvol- 
atile memory 57 for each ignition cycle. When power is supplied to the automatic rearview mirror system through the 
ignition switch controlled power circuit, the regulation and transient protection circuit 22 supplies 5 volts to the light 
sensing and logic circuit 26, which begins system initialization for a set period of between zero (0) seconds and two (2) 

25 minutes, but preferably 30 seconds. This delay condition or wait state reduces the opportunity for vehicle thieves to 
detect SSI which may be emitted during the image optimization process of Figure 12. After the wait state has ended, 
the compartment image data storage system operates as has already been described with respect to Figs. 12A and 
12B. The nonvolatile memory 57 should be sufficiently large to store a number N of valid image data frames RA< t) to 
document N sequential ignition cycles where N is in the range of 2 to 1 0, but is preferably 5. The image data frames are 

30 addressed via pointers that select a general memory location which are used to store each valid image data frame 
RA{ t ). The pointer addressing scheme is cycled on a first-in-first-out (FIFO) basis so that the most recent valid image 
data frames replace the "oldest" image data frames in the nonvolatile memory 57. After storing a valid image data frame 
RA( t) , the system ends cycling and enters a dormant state waiting for the next ignition cycle. 

Alternatively, multiple valid image data frames may be stored for a single ignition cycle. This second version of the 

35 compartment image data storage system performs exactly as the first description except as follows. After storage of the 
initial image data frame, the system returns to step S31 0 and the logic circuit 46 generates a random wait state ranging 
from 8 to 1 5 minutes during which the system stops generating image data frames. After the wait state has ended, the 
system proceeds to attempt generate another valid image data frame. This cycle of randomly waiting and then attempt- 
ing to generate valid image data frames is continued as long as the ignition supplies power to the system. This 

40 approach is more difficult for thieves to defeat. This system may also be configured as a real-time image data storage 
system (e.g., 30 frames per second). Of course, since at least several hundred image data frames may need to be proc- 
essed, compressed and stored in the nonvolatile memory 57, the processing and nonvolatile memory storage require- 
ments are significantly greater than for the other image data storage systems described above. An initiation sensor, 
such as accelerometers, motion sensors, vibration sensors or any other sensor capable of detecting vehicle motion, 

45 inputs an initiation signal, and after receiving the initiation signal, the light sensing and logic circuit 26 generates and 
stores in real-time the image data frames for a predetermined period, such as 10 seconds. 

The nonvolatile memory 57 is preferably housed in a separate module in a physically difficult to access location 
within the vehicle, such as high on the fire wall behind the instrument cluster. The module is preferably a durable metal 
housing or other housing sufficiently durable so that it will protect the nonvolatile memory 57 from extreme shock or 

so heat, such as might occur in a vehicle accident. To better ensure that the image data frames in the nonvolatile memory 
57 are not accessed by unauthorized personnel, access may be limited by the security access/decoding logic 58. The 
security access codes necessary to access the image data frames may, for example, be distributed only to authorized 
persons. When the proper security access code is entered, the image data frames may accessed through the access 
port 59; typically, the access port 59 is a multi-pin connector to which a data retrieval system may be connected. 

55 It should be understood that the vehicle interior monitoring system described above, including the vehicle intrusion 
detection system and the compartment image data storage system configurations, may be implemented as an inde- 
pendent or stand-alone system in a module (without the automatic rearview mirror system), and that it may be mounted 
independently within the vehicle, such as in the head liner, headliner console or other appropriate areas. 

The performance of the vehicle interior monitoring systems described herein may be enhanced by providing 
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enhanced infrared reflectance characteristics in certain areas within the vehicle interior 100. For example, some fibers 
(such as cotton and silk) tend to reflect near infrared illumination better than other f foers (such as nylon and rayon) 
which tend to absorb near infrared illumination. Therefore, a pattern may be established in the vehicle interior 100 such 
as on the driver seat 101 or passenger seat 102 or front or rear seats or on the vehicle's interior door panels, etc., by 

5 using different fibers or other materials to establish a pattern, such as a grid or any other appropriate pattern. Near infra- 
red illumination of the pattern provides a higher contrast image to the photosensor array 32. This better ensures that 
the logic circuit 46 accurately determines, for example, the presence of an intruder, an occupant or other object (such 
as a child restraint system in the front passenger seat). 

Using fibers or materials having better infrared reflectance characteristics as described above is useful both during 

10 the day and at night. During the day, any near infrared reflective pattern in the vehicle will generally provide a higher 
contrast pattern to the photosensor array 32 because of natural sources (sunlight) or supplemental sources of near 
infrared of illumination. In particular, if light levels fall below some predetermined level (typically in the range of about 

0. 1 lux to 5 lux), then near infrared SSI may be used to provide a higher contrast image pattern to the photosensor array 
32. 

75 The vehicle interior monitoring system may also be used to monitor the vehicle interior 100 to determine whether 
there is an adult occupant, a child restraint system or no occupant in the front or rear passenger seat areas. Various 
mechanical and electrical sensors have been considered or used for detecting or sensing the size and presence of vehi- 
cle occupants, particularly those in the front passenger seat. These sensors include pressure sensors (mechanical and 
solid-state), accelerometers, ultrasonic sensors and mechanical or electrical switch mechanisms for indicating seat belt 

20 use. As air bags are becoming more prevalent, vehicle owners, insurance companies and automotive companies have 
a strong interest in having air bags deploy properly at all times, since replacing deployed airbags is costly. Additionally, 
there has been some discussion as to whether air bags should deploy when there is a child restraint system that is posi- 
tioned rearwardly facing in the front passenger seat. Since performance requirements are stringent for safety related 
components, it is problematic to make appropriate airbag deployment decisions using currently known sensor technol- 

25 ogies. The vehicle interior monitoring system may be configured as a vehicle occupant detection system that may be 
used to aid in the intelligent deployment of air bags depending, for example, on the status of the vehicle occupant. 
Image information, such as size, shape, contour and motion may be processed by the logic circuit 46 to determine 
whether to output a control signal to the air bag deployment system to prevent an air bag from deploying (such as a pas- 
senger air bag when there is no front seat passenger) or for controlling the rate at which the airbag deploys. 

30 The individual components represented by the blocks shown in the schematic block diagrams of Figs. 6, 6A, 1 0 and 
10A are well known in the art relating to automatic rearview mirrors and vehicle intrusion detection systems, and their 
specific construction and operation is not critical to the invention or the best mode for carrying out the present invention. 
Moreover, the logic flow charts discussed in the specification and shown in Figs. 7, 8A, 6B, 12, 12A and 12B may be 
implemented in digital hardwired logic or programmed into well-known signal processors, such as microprocessors, by 

35 persons having ordinary skill in the art. Since such digital circuit construction or programming per se is not part of the 
invention, no further description thereof is deemed necessary. 

While the present invention has been described in connection with what are the most practical and preferred 
embodiments as currently contemplated, it should be understood that the present invention is not limited to the dis- 
closed embodiments. Accordingly, the present invention is intended to cover various modifications and equivalent 

40 arrangements, methods and structures that are within the spirit and scope of the claims. 

Claims 

1 . A compartment image data storage system for an automotive vehicle, comprising: 

45 

photosensor array means (32) for sensing light levels in at least a portion of a vehicle compartment and gen- 
erating at least a first set of photosensor array signals; 

determining means (46) coupled to said photosensor array means (32) for receiving said at least a first set of 
photosensor array signals and determining at least a first set of values indicative of at least a portion of said at 
so feast a first set of photosensor array signals; and 

memory means (57) coupled to said determining means (46) for receiving and storing said at least a first set 
of values indicative of said at least a first set of photosensor array signals. 

2. A compartment image data storage system according to claim 1 , 
55 characterized in that 

said memory means (57) comprise a nonvolatile memory. 

3. A compartment image data storage system according to claim 1 or 2, 
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characterized by 

compressing means (56) for compressing said at least a first set of values indicative of said at least a first set 
of photosensor array signals, wherein said memory means (57) are provided for storing the compressed ver- 
sion of said at least a first set of values indicative of said at least a first set of photosensor array signals. 

4. A compartment image data storage system according to any one of claims 1 to 3, 
characterized in that 

an access/security decoding circuit (58) is provided which is coupled to said memory means (57) and allows 
access to said memory means (57) only after an authorized code has been entered. 

5. A compartment image data storage system according to any one of claims 1 to 4, 
characterized in that 

both said determining means (46) and said memory means (57) are adapted to determine and, respectively, 
store said at least a first set of values indicative of said at least a first set of photosensor array signals in real- 
time for a predetermined period of time after having received an inrtation signal of inrtation sensor means. 

6. A compartment image data storage system according to any one of claims 1 to 5, 
characterized in that 

said at least a first set of values indicative of said at least a first set of photosensor array signals corresponds 
to image data of a driver of said vehicle. 

7. A vehicle intrusion detection system for detecting movement within a vehicle interior for an automotive vehicle, 
comprising: 

said compartment image data storage system according to any one of claims 1 to 6, wherein said photosensor 
array means (32) generate at least said a first set of photosensor array signals and a second set of photosen- 
sor array signals and said determining means (46) determine at least said first set of values and a second set 
of values indicative of at least a portion of said at least a first set and a second set of photosensor array signals; 
and 

comparing means (46) coupled to said determining means (46) for receiving said at least a first set and a sec- 
ond set of values indicative of said at least a first set and a second set of photosensor array signals and com- 
paring said at least a first set and a second set of values to generate at least one output control signal indicative 
of the correlation between said at least a first set and a second set of values. 

8. A vehicle intrusion detection system according to claim 7, 
characterized in that 

said comparing means (46) output said at least one output control signal in case said at least a first set and a 
second set of values indicative of said at least a first set and a second set of photosensor array signals mis- 
match, wherein the difference between said at least a first set and a second set of values fulfils a predeter- 
mined mismatch condition; and 

said comparig means (46) output said at least one output control signal as a control signal used for directly 
controlling hardware of said vehicle and/or used as input to a vehicle controller system. 

9. A control system for monitoring a vehicle interior and for controlling at least one variable reflectance mirror (1) for 
an automotive vehicle, comprising: 

said compartment image data storage system according to any one of claims 1 to 6; and 
second determining means (46) coupled to said photosensor array means (32) for receiving said at least a first 
set of photosensor array signals and determining from at least a portion of said at least a first set of photosen- 
sor array signals a signal for controlling said at least one variable reflectance mirror (1). 
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FIG. 5 







33d 

/ 


44 

/ 

> 

33a 


33c 
32a 


rt 


rt 


rt 


rt 


rt 


rt 


rti 


- i 




6- 


6- 




a 


a 


a 


a 






a 








a 


a 


a 




a 


a 


a 






a 


a 


a 




a 


a 








a 


a 


a 




a 


6- 




a 


a 


a 


a 


a 




a 










a 


a 


a 




a 


a 








a 


a 


a 




a 




a 




a 


a 


a 


a 





33 



EP0788 947A1 



CO 
O 

Li. 




CO 
CVJ 



34 



EP0 788 947A1 




35 



EP 0788 947 A1 



FIG. 7 
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